-- Logs begin at Mon 2022-08-29 20:26:20 UTC, end at Mon 2022-08-29 21:48:47 UTC. -- Aug 29 21:07:20.259163 dv-cinder-854264-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 21:07:20.271926 dv-cinder-854264-2-smb devstack@keystone.service[81921]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:07:20 2022] *** Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: nodename: dv-cinder-854264-2-smb Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: machine: x86_64 Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: clock source: unix Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: pcre jit disabled Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: detected number of CPU cores: 4 Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: current working directory: / Aug 29 21:07:20.274712 dv-cinder-854264-2-smb devstack@keystone.service[81921]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:07:20.275628 dv-cinder-854264-2-smb devstack@keystone.service[81921]: your processes number limit is 47680 Aug 29 21:07:20.275628 dv-cinder-854264-2-smb devstack@keystone.service[81921]: your memory page size is 4096 bytes Aug 29 21:07:20.275628 dv-cinder-854264-2-smb devstack@keystone.service[81921]: detected max file descriptor number: 2048 Aug 29 21:07:20.275628 dv-cinder-854264-2-smb devstack@keystone.service[81921]: lock engine: pthread robust mutexes Aug 29 21:07:20.275628 dv-cinder-854264-2-smb devstack@keystone.service[81921]: thunder lock: enabled Aug 29 21:07:20.275628 dv-cinder-854264-2-smb devstack@keystone.service[81921]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 21:07:20.275628 dv-cinder-854264-2-smb devstack@keystone.service[81921]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:07:20.316284 dv-cinder-854264-2-smb devstack@keystone.service[81921]: Python main interpreter initialized at 0x5605ec5d69c0 Aug 29 21:07:20.316284 dv-cinder-854264-2-smb devstack@keystone.service[81921]: python threads support enabled Aug 29 21:07:20.316284 dv-cinder-854264-2-smb devstack@keystone.service[81921]: your server socket listen backlog is limited to 100 connections Aug 29 21:07:20.316284 dv-cinder-854264-2-smb devstack@keystone.service[81921]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:07:20.317202 dv-cinder-854264-2-smb devstack@keystone.service[81921]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:07:20.317202 dv-cinder-854264-2-smb devstack@keystone.service[81921]: *** Operational MODE: preforking *** Aug 29 21:07:20.317612 dv-cinder-854264-2-smb devstack@keystone.service[81921]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:07:20.317612 dv-cinder-854264-2-smb devstack@keystone.service[81921]: spawned uWSGI master process (pid: 81921) Aug 29 21:07:20.317860 dv-cinder-854264-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 21:07:20.319453 dv-cinder-854264-2-smb devstack@keystone.service[81921]: spawned uWSGI worker 1 (pid: 81931, cores: 1) Aug 29 21:07:20.319453 dv-cinder-854264-2-smb devstack@keystone.service[81921]: spawned uWSGI worker 2 (pid: 81932, cores: 1) Aug 29 21:07:20.319453 dv-cinder-854264-2-smb devstack@keystone.service[81921]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:07:24.775834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:07:24.775834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: from cryptography.utils import int_from_bytes Aug 29 21:07:24.776648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:07:24.776648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: from cryptography.utils import int_from_bytes Aug 29 21:07:24.777107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:07:24.777107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: from cryptography.utils import int_from_bytes Aug 29 21:07:24.777251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:07:24.777251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: from cryptography.utils import int_from_bytes Aug 29 21:07:24.827907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:07:24.828084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:07:24.828315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] command line args: [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:07:24.828547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:07:24.828716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ================================================================================ {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:07:24.828972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] admin_token = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.829246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] config_dir = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.829420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.829607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] config_source = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.829823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] debug = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.829980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.831717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.831717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.831717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.831717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.831717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] list_limit = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.831717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] log_config_append = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.832157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.832157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] log_dir = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.832276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] log_file = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.832546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.832778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.832953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.833161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:07:24.833274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.833348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:07:24.833415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.833482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] command line args: [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:07:24.833540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.833726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:07:24.833843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.833925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ================================================================================ {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:07:24.834005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] admin_token = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] config_dir = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] config_source = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.834912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] debug = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.835007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.835118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.835229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.835362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.835948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.836075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.836179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.836334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.836582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.836680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.836852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] publish_errors = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.836944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] list_limit = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.837143 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.837238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] log_config_append = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.837390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.837558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.837650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.837836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.837936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] log_dir = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.838041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.838200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] log_file = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.838950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] standard_threads = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] use_journal = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] use_json = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] use_stderr = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] use_syslog = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.839991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.840055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.840183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.840285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.840420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.840500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.840658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.840817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.840944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.841148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.841245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.841397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.841485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.841662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.841745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.841903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.842153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.842229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.842422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] publish_errors = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.842574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.842662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.842734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.842863 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.842948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.843130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.843217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.843293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.843369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.843518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.843603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.843754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] standard_threads = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.843834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.843988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.844065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.844235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.844313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.844412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.844496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.844589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] use_journal = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.844738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.844824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] use_json = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.844926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] use_stderr = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.845018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.845140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] use_syslog = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.845246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.845356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:07:24.845510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.845621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.845764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.845865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.846948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.847161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.847237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.847403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.847487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.847639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.847712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.848998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.849983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.850920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.851094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.851738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.851824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.851905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852683 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.852911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.853929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.854189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.854361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.854476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.854668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.854777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.854913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.855888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.856938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.857050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.857200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.857309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.858998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.859967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.860886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.861931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.862987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.863917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.864054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.864140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.864352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.864431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.864592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.864671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.864877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.865965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.866130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.866214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.866385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] auth.external = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.866474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.866613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.866694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.866935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] auth.password = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867628 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] auth.token = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.867946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.868902 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] credential.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.869874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.870974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.871934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.872015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.872176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.872259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.872437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.872518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.872703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.872802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.873097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.879583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.879583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] auth.external = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.879765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.879840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.879913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.879913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] auth.password = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] auth.token = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.880954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] credential.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.881958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.882991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.883972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.884980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.885918 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.886989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.887924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.888970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.889983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890064 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.890951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.891976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.892186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.892311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.892404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.892467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.892687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.892773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.892940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893443 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.893994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.894947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.895892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.896939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.897880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.898466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.898662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.898736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.898914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.898994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.899970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] role.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] role.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.900908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.901893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.902862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.903944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.904201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.904421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.904421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.904653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.904741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.904900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.905002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.905259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.905357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.905511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.905593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.905764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.905848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.906968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] role.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] role.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.907998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.908163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.908248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.908410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.908500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.908665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.908824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.908935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.909987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.910913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.911999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.912988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.913167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.913243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.913407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.913476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.913704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.914316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.connection = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.914479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.914552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.914713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.914782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.914968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.915919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.916000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.916152 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.916232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.916394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.916472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.916662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.916938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.917939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.918861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:07:24.918924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.919120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.919356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.919605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.919886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.920119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.920365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.920632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.920894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.connection = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.921163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.921414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.921652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.921894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.922130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.922366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.922600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.922835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.923083 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.923315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.923557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.923793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.924041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.924276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.924522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.924754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.924997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.925260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:07:24.925429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:07:24.948864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.949112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.949342 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.950935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.951170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.951397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.957847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.959913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.987093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.987322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.989231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:24.989467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.058682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.058853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.108595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.108821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.109132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.109373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.284271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.284560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.284712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.284933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.285183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.285407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.285641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.285878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.286133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.286357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.286579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.286799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.322423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.322625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.322791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.322898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.323944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.324153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.335307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.336362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.348911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.349999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.350091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.350213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.350318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.350428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.350643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:07:25.367259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.367464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:07:25.367621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.367751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:07:25.367842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.368004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:07:25.368093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.368280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.368365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:07:25.368545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.368634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.368807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.368897 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.369085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.369394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.369632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.378826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.379159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.379275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.379427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.379513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.379709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.379803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.380033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.387495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.387669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.390467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.390657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.390784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.390926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.391063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.391204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.391359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.391488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.391621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.391754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.391876 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.392997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.393181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.393312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.393510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.417412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.417750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.418925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.419227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.419328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.419532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.423967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.424106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.424266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.424357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.424572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.424680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.431603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.431779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.431869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.432071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.436034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.436175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.436329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.436425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.436639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.436754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.436928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.437029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.437235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.437390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.437548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.437812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.438078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.439377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.439676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.439971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.456527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.456741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.456829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.456938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.460795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.460928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.463971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.464294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.464417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.464546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.468644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.468843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.471799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.472057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.474939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.479770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.492880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.493295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.493503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.493692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.493837 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.493989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.494263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.494534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.500525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.501528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.502229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.503099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.503781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.504058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.504708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.504979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.506744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.507030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.507386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.508177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.508359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.508453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.508657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.509157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.509375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.509745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.519914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.520206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.522466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.522466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.522466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.522868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.522999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.523134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.523267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.523403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.523403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.523403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.523403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.523403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.537178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.538702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.540277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.541672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.543231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.544587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.544748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.546112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.546281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.546475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.546878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.547730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.548021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.548307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.555374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.556912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.558997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.568519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.568519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.569175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.569469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.569756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.577167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.577353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.577444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.577641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.577738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.577925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.578227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.578507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.578803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.579107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.579388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.579694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.579945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.580221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.580486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.580764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.581042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.584579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:07:25.584865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.585194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.585501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.585779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.586060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.586372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.586627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.586910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.587189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.587461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.587723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.587992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.588274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:07:25.617332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605ec5d69c0 pid: 81932 (default app) Aug 29 21:07:25.620877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896540cd-e3c0-48df-87a9-1d507b08f08e None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:25.621200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896540cd-e3c0-48df-87a9-1d507b08f08e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:25.621480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896540cd-e3c0-48df-87a9-1d507b08f08e None None] PATH_INFO: `/v3` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:25.624119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605ec5d69c0 pid: 81931 (default app) Aug 29 21:07:25.625767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Mon Aug 29 21:07:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:34.145500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258dd0a-e781-441a-9dc6-aeb780a31bfe None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:34.146008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258dd0a-e781-441a-9dc6-aeb780a31bfe None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:34.146008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258dd0a-e781-441a-9dc6-aeb780a31bfe None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:34.150331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:07:34.156635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:34.157238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:34.157238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:34.230829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: INFO dbcounter [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] Registered counter for database keystone Aug 29 21:07:34.255808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG oslo_db.sqlalchemy.engines [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:07:34.265084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writer thread running {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:07:34.466353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG passlib.handlers.bcrypt [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81932) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 21:07:34.466657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG passlib.handlers.bcrypt [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81932) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 21:07:34.533129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:34.534741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:34.695623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 21:07:35.236060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258dd0a-e781-441a-9dc6-aeb780a31bfe None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:35.309158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: INFO dbcounter [None req-d258dd0a-e781-441a-9dc6-aeb780a31bfe None None] Registered counter for database keystone Aug 29 21:07:35.328870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG oslo_db.sqlalchemy.engines [None req-d258dd0a-e781-441a-9dc6-aeb780a31bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:07:35.336007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writer thread running {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:07:35.458048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258dd0a-e781-441a-9dc6-aeb780a31bfe None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:35.463333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aad01-4ffe-4d33-a9a4-74af8b8348a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:35.464002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aad01-4ffe-4d33-a9a4-74af8b8348a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:35.464284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aad01-4ffe-4d33-a9a4-74af8b8348a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:35.464556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aad01-4ffe-4d33-a9a4-74af8b8348a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:35.477100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aad01-4ffe-4d33-a9a4-74af8b8348a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:35.529327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1d4aad01-4ffe-4d33-a9a4-74af8b8348a2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 21:07:35.529586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aad01-4ffe-4d33-a9a4-74af8b8348a2 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:35.540684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Aug 29 21:07:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:07:35.551604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:35.572478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f17179-bc32-44d2-abba-24fadd7e088d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:35.579042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44351a72-2d1a-4058-b499-0ed1c4c33d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:35.580380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351a72-2d1a-4058-b499-0ed1c4c33d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:35.580662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351a72-2d1a-4058-b499-0ed1c4c33d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:35.580976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351a72-2d1a-4058-b499-0ed1c4c33d70 admin admin] PATH_INFO: `/v3/projects/635783c99cd6429c8d3d3df5393b1353` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:35.582700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44351a72-2d1a-4058-b499-0ed1c4c33d70 admin admin] RBAC: Authorizing `identity:get_project(project_id=635783c99cd6429c8d3d3df5393b1353)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:35.637251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44351a72-2d1a-4058-b499-0ed1c4c33d70 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 21:07:35.637620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44351a72-2d1a-4058-b499-0ed1c4c33d70 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:35.642377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Mon Aug 29 21:07:35 2022] GET /identity/v3/projects/635783c99cd6429c8d3d3df5393b1353 => generated 344 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:37.588027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c0dd1-a27b-4278-9e0e-140bb983fff7 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:37.588549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c0dd1-a27b-4278-9e0e-140bb983fff7 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:37.588549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c0dd1-a27b-4278-9e0e-140bb983fff7 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:37.592695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:37.598520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989d79-18d6-4fc8-bd9c-7e5727fe3942 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:37.598947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989d79-18d6-4fc8-bd9c-7e5727fe3942 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:37.599064 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989d79-18d6-4fc8-bd9c-7e5727fe3942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:37.620435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-66989d79-18d6-4fc8-bd9c-7e5727fe3942 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:37.622045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-66989d79-18d6-4fc8-bd9c-7e5727fe3942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:37.630060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 21:07:37.910436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c0dd1-a27b-4278-9e0e-140bb983fff7 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:37.924480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c0dd1-a27b-4278-9e0e-140bb983fff7 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:37.929781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a605c-fd5e-4eb9-9c72-55ec9760c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:37.930402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a605c-fd5e-4eb9-9c72-55ec9760c23b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:37.930700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a605c-fd5e-4eb9-9c72-55ec9760c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:37.930978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a605c-fd5e-4eb9-9c72-55ec9760c23b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:37.941496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a605c-fd5e-4eb9-9c72-55ec9760c23b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:37.943538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a605c-fd5e-4eb9-9c72-55ec9760c23b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:37.952750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Aug 29 21:07:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:07:37.959776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989d79-18d6-4fc8-bd9c-7e5727fe3942 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:37.969386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989d79-18d6-4fc8-bd9c-7e5727fe3942 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:37.973812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942b257-8925-4bce-b4ee-440293e5d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:37.974444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b257-8925-4bce-b4ee-440293e5d087 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:37.974722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b257-8925-4bce-b4ee-440293e5d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:37.974994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b257-8925-4bce-b4ee-440293e5d087 admin admin] PATH_INFO: `/v3/users/0a6a88d51a2749349d397dd703210284` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:37.976806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b257-8925-4bce-b4ee-440293e5d087 admin admin] RBAC: Authorizing `identity:get_user(user_id=0a6a88d51a2749349d397dd703210284)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:37.978670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b257-8925-4bce-b4ee-440293e5d087 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:37.980230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Mon Aug 29 21:07:37 2022] GET /identity/v3/users/0a6a88d51a2749349d397dd703210284 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:40.016245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1029e-9f22-4e16-8960-5de1763b8fce None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.016767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1029e-9f22-4e16-8960-5de1763b8fce None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.016767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1029e-9f22-4e16-8960-5de1763b8fce None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.018321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:40.025219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4496ed-946e-416d-b78b-c62b1ecaa8b6 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.025881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4496ed-946e-416d-b78b-c62b1ecaa8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.025881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4496ed-946e-416d-b78b-c62b1ecaa8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.044955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-dc4496ed-946e-416d-b78b-c62b1ecaa8b6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:40.046169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-dc4496ed-946e-416d-b78b-c62b1ecaa8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:40.119834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aafb3-953f-457c-acf7-73a1bcb50c1d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.120182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aafb3-953f-457c-acf7-73a1bcb50c1d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.120804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aafb3-953f-457c-acf7-73a1bcb50c1d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.123078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:40.130801 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.131265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.131710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.144116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:40.186836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG passlib.handlers.bcrypt [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81931) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 21:07:40.187295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG passlib.handlers.bcrypt [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81931) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 21:07:40.237477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:40.239066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:40.344452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:07:40.411787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4496ed-946e-416d-b78b-c62b1ecaa8b6 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:40.437711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:40.528164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4496ed-946e-416d-b78b-c62b1ecaa8b6 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:40.565237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:40.565815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.566234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.566469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.579158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:07:40.588900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:40.590015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:07:40.590993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:40.596066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:40.620273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:40.707847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7c5bc-d852-4561-93fb-5058373abe92 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:40.710908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:40.716217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:40.741602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac743-115d-4ce3-805b-3aafdd071078 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:40.752244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:40.753267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.753553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.753851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.754797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:40.755110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:40.756584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:40.769690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:40.775925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:40.786308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:40.786957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.787262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.787544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.866206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:40.867705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:40.886311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd05a7-4646-4443-bf4c-fa4f4fcb4df0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:40.927724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:40.928627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:40.928963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:40.929288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] PATH_INFO: `/v3/users/0a6a88d51a2749349d397dd703210284` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:40.930900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] RBAC: Authorizing `identity:get_user(user_id=0a6a88d51a2749349d397dd703210284)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:40.932417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:40.934169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 9/16] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:07:40 2022] GET /identity/v3/users/0a6a88d51a2749349d397dd703210284 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:40.939911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:40.957629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:40.978740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:40.978990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 8/17] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:07:40.985221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:41.064266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcfa9f-b594-4fbc-aaff-4e80431777ec None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:41.103765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d12e-1ea5-4f6e-be18-93cd9459da1d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:41.111020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:41.111661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:41.111991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:41.112265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:41.113475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:41.114919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:41.116523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:41.123882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:41.147494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:41.148693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:41.148974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:41.149283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:41.160307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:41.161820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:07:41.180106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:41.181324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:07:41.182155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:07:41.182155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:07:41.182155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:07:41.182155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:07:41.188612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:41.232039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:41.250706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be128a38-b70e-4692-ba0c-6a7954f151ec None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:41.252366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:41.287369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfe7d4-6607-4637-9e10-0f93f0159dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:41.287982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfe7d4-6607-4637-9e10-0f93f0159dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:41.288292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfe7d4-6607-4637-9e10-0f93f0159dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:41.288610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfe7d4-6607-4637-9e10-0f93f0159dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:41.289369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfe7d4-6607-4637-9e10-0f93f0159dc6 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.domain.id=default, user.id=0a6a88d51a2749349d397dd703210284) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:41.289678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfe7d4-6607-4637-9e10-0f93f0159dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:41.291149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfe7d4-6607-4637-9e10-0f93f0159dc6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:41.301867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Aug 29 21:07:41 2022] GET /identity/v3/role_assignments?user.id=0a6a88d51a2749349d397dd703210284&scope.domain.id=default&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 233 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:41.316361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d4a70-6b30-402c-897b-1018ec82d9f8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:41.363540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4de61d-2ee0-4f19-a8cb-e4abf1bcd9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:41.364181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de61d-2ee0-4f19-a8cb-e4abf1bcd9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:41.364460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de61d-2ee0-4f19-a8cb-e4abf1bcd9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:41.364722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de61d-2ee0-4f19-a8cb-e4abf1bcd9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:41.365421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4de61d-2ee0-4f19-a8cb-e4abf1bcd9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:41.365723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4de61d-2ee0-4f19-a8cb-e4abf1bcd9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:41.372489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4de61d-2ee0-4f19-a8cb-e4abf1bcd9b6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:41.389715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:44.354344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03df5b-63d2-4ab4-8c0d-2118309b81e5 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:44.354882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03df5b-63d2-4ab4-8c0d-2118309b81e5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:44.355326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03df5b-63d2-4ab4-8c0d-2118309b81e5 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:44.357841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:07:44.374583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74a5c-57b4-45eb-b391-8413e11aac9c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:44.375111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74a5c-57b4-45eb-b391-8413e11aac9c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:44.375541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74a5c-57b4-45eb-b391-8413e11aac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:44.426734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ddb74a5c-57b4-45eb-b391-8413e11aac9c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:44.429313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ddb74a5c-57b4-45eb-b391-8413e11aac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:44.440212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228dc1-ecc7-446d-adc8-49326da2a1cd None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:44.440702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228dc1-ecc7-446d-adc8-49326da2a1cd None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:44.441240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228dc1-ecc7-446d-adc8-49326da2a1cd None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:44.444537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 13/23] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:44.453524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cd1c-cba1-4986-83ba-94f801d83866 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:44.454018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cd1c-cba1-4986-83ba-94f801d83866 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:44.454515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cd1c-cba1-4986-83ba-94f801d83866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:44.531930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a0f8cd1c-cba1-4986-83ba-94f801d83866 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:44.534019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a0f8cd1c-cba1-4986-83ba-94f801d83866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:44.682330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 11/24] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:07:44.684608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7378fe-ac3d-4d71-acd2-d9e029319cee None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:44.685119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7378fe-ac3d-4d71-acd2-d9e029319cee None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:44.685562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7378fe-ac3d-4d71-acd2-d9e029319cee None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:44.695895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 12/25] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:44.703736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd1b8-ccac-4a6a-8b5d-778da5b95d7c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:44.706919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd1b8-ccac-4a6a-8b5d-778da5b95d7c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:44.708785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd1b8-ccac-4a6a-8b5d-778da5b95d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:44.760702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-09ebd1b8-ccac-4a6a-8b5d-778da5b95d7c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:44.763102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-09ebd1b8-ccac-4a6a-8b5d-778da5b95d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:44.766494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 14/26] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:44.827631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:44.964862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 13/27] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:45.199911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7b291-c308-4a7a-9c46-393ae46972d9 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:45.200813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7b291-c308-4a7a-9c46-393ae46972d9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:45.201372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7b291-c308-4a7a-9c46-393ae46972d9 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:45.203269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 15/28] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:45.212919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc051d-ba71-4490-8e69-7d1bd9abcc4b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:45.213407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc051d-ba71-4490-8e69-7d1bd9abcc4b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:45.213878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc051d-ba71-4490-8e69-7d1bd9abcc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:45.242212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-07bc051d-ba71-4490-8e69-7d1bd9abcc4b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:45.243532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-07bc051d-ba71-4490-8e69-7d1bd9abcc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:45.347505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 14/29] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:45.369267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7b291-c308-4a7a-9c46-393ae46972d9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:45.502263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc051d-ba71-4490-8e69-7d1bd9abcc4b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:45.525210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:45.530137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7b291-c308-4a7a-9c46-393ae46972d9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:45.607410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:45.608072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:45.608381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:45.608624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:45.636958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:07:45.654762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:45.656362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:07:45.657844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 16/30] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:07:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:45.667148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:45.800589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:45.863837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc051d-ba71-4490-8e69-7d1bd9abcc4b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:45.948204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880dbf8-2186-454f-bf1f-e8391b8700e5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:45.966460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:45.967508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:45.968004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:45.968637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:45.988661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:45.990697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:46.012694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:46.013668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.014173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.014591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:07:46.014785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:46.015802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:07:46.016688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:07:46.016688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:07:46.016688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:07:46.016688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 15/31] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 515 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:46.017207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:46.017983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:46.018578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:46.020406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:46.032454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 17/32] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:07:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:46.037935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:46.062200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:46.175536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2a22-ffa1-4ba6-87b7-cd20b6b82e33 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:46.187503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9643c-b58b-4dbd-acb5-bc00b0a4009a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:46.218794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:46.219900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.220669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.221313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.222600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:46.224793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:46.253638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:46.254374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.254669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.254945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.255641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:46.257667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:46.264703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:46.489167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 18/33] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 21:07:46 2022] POST /identity/v3/roles => generated 225 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:07:46.489167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:46.540504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 16/34] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 21:07:46 2022] POST /identity/v3/roles => generated 219 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:07:46.542236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:46.650273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:46.693574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94982503-d32f-40bd-a005-ca7696aaba95 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:46.724837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbd2f1-dcbe-4214-b3cf-045ae26d388c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:46.781320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:46.782271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.782752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.783228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:46.785038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:46.787663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:46.793381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e6c9-5133-4357-a18e-eb701915cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:46.794063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e6c9-5133-4357-a18e-eb701915cf63 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.794351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e6c9-5133-4357-a18e-eb701915cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.794649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e6c9-5133-4357-a18e-eb701915cf63 None admin] PATH_INFO: `/v3/users/0a6a88d51a2749349d397dd703210284` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.796268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66e6c9-5133-4357-a18e-eb701915cf63 None admin] RBAC: Authorizing `identity:get_user(user_id=0a6a88d51a2749349d397dd703210284)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:46.799011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66e6c9-5133-4357-a18e-eb701915cf63 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:46.800980 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 17/35] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:07:46 2022] GET /identity/v3/users/0a6a88d51a2749349d397dd703210284 => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:46.802497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573ab2-74f9-40c8-b0ed-d514ae12db31 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.802816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573ab2-74f9-40c8-b0ed-d514ae12db31 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.803100 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573ab2-74f9-40c8-b0ed-d514ae12db31 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.805451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 18/36] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:46.806766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052efa1-85ec-416a-8701-92e2798369fd None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.807060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052efa1-85ec-416a-8701-92e2798369fd None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.807339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052efa1-85ec-416a-8701-92e2798369fd None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.808762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 19/37] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:46.821602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af8dca-68c0-4146-b625-d7d6bb57f6e4 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.821998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af8dca-68c0-4146-b625-d7d6bb57f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.822233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af8dca-68c0-4146-b625-d7d6bb57f6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.826447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 19/38] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:46.831128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:46.850780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-65af8dca-68c0-4146-b625-d7d6bb57f6e4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:46.852568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-65af8dca-68c0-4146-b625-d7d6bb57f6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:46.950046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:46.961110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ddc34-ad18-49b7-a785-aede87852c51 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:46.961814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 20/39] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:07:46.963139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df154b8-9e26-4136-8ed2-f1c29f0c3e32 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:46.963450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df154b8-9e26-4136-8ed2-f1c29f0c3e32 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:46.963745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df154b8-9e26-4136-8ed2-f1c29f0c3e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:46.991894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1df154b8-9e26-4136-8ed2-f1c29f0c3e32 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:46.994279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1df154b8-9e26-4136-8ed2-f1c29f0c3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:47.013930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:47.015362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:47.016028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:47.016521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:47.019086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:47.021319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:47.030901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 20/40] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:47.030901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:47.040734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:47.193626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d476-7dde-4a44-ace7-88ca8f023782 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:47.251042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:47.251241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 21/41] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:47.252045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:47.252492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:47.252674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df154b8-9e26-4136-8ed2-f1c29f0c3e32 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:47.252940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:47.254099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:47.256749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:47.429209 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 21/42] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:07:47 2022] POST /identity/v3/projects => generated 301 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:07:47.429748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df154b8-9e26-4136-8ed2-f1c29f0c3e32 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:47.438752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:47.472739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:47.491128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:47.491837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:47.492121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:47.492394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] PATH_INFO: `/v3/domains/default/users/0a6a88d51a2749349d397dd703210284/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:47.494726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0a6a88d51a2749349d397dd703210284, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:47.496254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:47.561560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:47.611331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86625e03-7991-41f8-b2c2-561f306138a4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:47.643688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 22/43] 10.222.0.50 () {58 vars in 1361 bytes} [Mon Aug 29 21:07:47 2022] PUT /identity/v3/domains/default/users/0a6a88d51a2749349d397dd703210284/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:07:47.644527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:47.656795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:47.657687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:47.658318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:47.658786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:47.660808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:47.663314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:47.666234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 22/44] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:47.673999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:47.790620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d09a53-13f3-4a1f-b336-19b6e19554f0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:47.812295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711a930-0cbc-4324-8fd4-d3004767961d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:47.841124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821ad7c-bb0f-42f5-903a-a6957e70e201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:47.841124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821ad7c-bb0f-42f5-903a-a6957e70e201 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:47.841124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821ad7c-bb0f-42f5-903a-a6957e70e201 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:47.841124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821ad7c-bb0f-42f5-903a-a6957e70e201 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:47.841559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821ad7c-bb0f-42f5-903a-a6957e70e201 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:47.841795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821ad7c-bb0f-42f5-903a-a6957e70e201 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:47.854454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:47.864266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c9d4-c670-412c-a097-e63a1b05edf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:47.864963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c9d4-c670-412c-a097-e63a1b05edf9 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:47.865280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c9d4-c670-412c-a097-e63a1b05edf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:47.869399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c9d4-c670-412c-a097-e63a1b05edf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:47.869399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c9d4-c670-412c-a097-e63a1b05edf9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:47.869399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c9d4-c670-412c-a097-e63a1b05edf9 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:48.009170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:07:47 2022] POST /identity/v3/projects => generated 312 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:07:48.009527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 21:07:47 2022] POST /identity/v3/roles => generated 223 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:07:49.650360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2742-3d4b-473c-8f1a-52b749796867 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:49.650904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2742-3d4b-473c-8f1a-52b749796867 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:49.650904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2742-3d4b-473c-8f1a-52b749796867 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:49.652984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 24/47] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:49.658221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ed5a2-21a5-4e94-aa01-583d4dfeb68d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:49.658676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ed5a2-21a5-4e94-aa01-583d4dfeb68d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:49.658860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ed5a2-21a5-4e94-aa01-583d4dfeb68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:49.680277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-473ed5a2-21a5-4e94-aa01-583d4dfeb68d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:49.682119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-473ed5a2-21a5-4e94-aa01-583d4dfeb68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:49.728932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:49.761987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 24/48] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:50.018635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66691-ebbd-4479-a495-ba6bec816b82 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.019129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66691-ebbd-4479-a495-ba6bec816b82 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.019632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66691-ebbd-4479-a495-ba6bec816b82 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.022077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 25/49] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:50.030422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8df0a-3ad6-4685-8dc1-8ce8f12abb40 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.030735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8df0a-3ad6-4685-8dc1-8ce8f12abb40 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.031012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8df0a-3ad6-4685-8dc1-8ce8f12abb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.035106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66691-ebbd-4479-a495-ba6bec816b82 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:50.049917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-6fc8df0a-3ad6-4685-8dc1-8ce8f12abb40 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:50.051133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6fc8df0a-3ad6-4685-8dc1-8ce8f12abb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:50.155439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 25/50] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:50.162183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66691-ebbd-4479-a495-ba6bec816b82 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:50.224598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:50.225375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.225821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.226258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.240341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:07:50.246155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:50.249431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:07:50.250409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 26/51] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:07:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:50.254971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8df0a-3ad6-4685-8dc1-8ce8f12abb40 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:50.383954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8df0a-3ad6-4685-8dc1-8ce8f12abb40 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:50.386745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:50.422453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:50.423084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.423365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.423642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.424322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:50.424628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:50.426140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:50.439332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 26/52] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:07:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:50.443099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:50.445916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:50.494050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:50.567047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59818-43dc-4137-bacb-9a9bb03744fc None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:50.585523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0b75-d723-468c-90a1-fae808816037 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:50.613897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:50.614473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.614755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.615029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.616900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:50.618469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:50.620157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 27/53] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:50.626347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:50.627223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:50.628232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.628586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.628920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] PATH_INFO: `/v3/users/0a6a88d51a2749349d397dd703210284` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.630459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] RBAC: Authorizing `identity:get_user(user_id=0a6a88d51a2749349d397dd703210284)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:50.632681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:50.637251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 27/54] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:07:50 2022] GET /identity/v3/users/0a6a88d51a2749349d397dd703210284 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:50.642176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:50.687456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:50.752437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab1c2d-f143-477e-ae3a-3ec822cfc2de None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:50.762297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:50.798025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c1645-5e24-4176-8c47-94b0c31573bb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:50.800145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea06e14-778d-4f49-9363-65d9772ff327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:50.800809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea06e14-778d-4f49-9363-65d9772ff327 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.801182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea06e14-778d-4f49-9363-65d9772ff327 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.801556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea06e14-778d-4f49-9363-65d9772ff327 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.802421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea06e14-778d-4f49-9363-65d9772ff327 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:50.804120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea06e14-778d-4f49-9363-65d9772ff327 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:50.846388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:50.847160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:50.847556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:50.847967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:50.849554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:50.851900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:50.854585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:50.862626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:51.001168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c545e4-de8e-4e36-b1dc-9f2bbee0d78f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:51.008936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:51.040217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa71f41-b070-4e0f-88f7-c7b37181b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:51.040840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa71f41-b070-4e0f-88f7-c7b37181b33a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:51.041172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa71f41-b070-4e0f-88f7-c7b37181b33a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:51.041713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa71f41-b070-4e0f-88f7-c7b37181b33a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:51.042234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa71f41-b070-4e0f-88f7-c7b37181b33a None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.domain.id=default, user.id=0a6a88d51a2749349d397dd703210284) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:51.042547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa71f41-b070-4e0f-88f7-c7b37181b33a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:51.044034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa71f41-b070-4e0f-88f7-c7b37181b33a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:51.051933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 29/56] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Aug 29 21:07:50 2022] GET /identity/v3/role_assignments?user.id=0a6a88d51a2749349d397dd703210284&scope.domain.id=default&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 530 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:07:51.105198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 28/57] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Aug 29 21:07:50 2022] POST /identity/v3/projects => generated 298 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:07:53.202555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3a60-5a85-45bd-96f8-f41cfa89d402 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:53.203089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3a60-5a85-45bd-96f8-f41cfa89d402 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:53.203089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3a60-5a85-45bd-96f8-f41cfa89d402 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:53.204364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 30/58] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:53.210249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485fde-67c6-430c-b124-3425d292ddd3 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:53.210751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485fde-67c6-430c-b124-3425d292ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:53.210870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485fde-67c6-430c-b124-3425d292ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:53.230728 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-85485fde-67c6-430c-b124-3425d292ddd3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:53.232357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-85485fde-67c6-430c-b124-3425d292ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:53.412521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 29/59] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:53.701908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca3a60-5a85-45bd-96f8-f41cfa89d402 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:53.827133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca3a60-5a85-45bd-96f8-f41cfa89d402 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:53.876889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ca49-e38d-419f-ae15-b9f1053f886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:53.877561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ca49-e38d-419f-ae15-b9f1053f886f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:53.877843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ca49-e38d-419f-ae15-b9f1053f886f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:53.878121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ca49-e38d-419f-ae15-b9f1053f886f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:53.879307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ca49-e38d-419f-ae15-b9f1053f886f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:53.880771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ca49-e38d-419f-ae15-b9f1053f886f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:53.882606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 31/60] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:53.888504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485fde-67c6-430c-b124-3425d292ddd3 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:54.018640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:54.039090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485fde-67c6-430c-b124-3425d292ddd3 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:54.079994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d161b3-09c2-45bb-b758-9cd2d2c98873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:54.080664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d161b3-09c2-45bb-b758-9cd2d2c98873 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:54.080941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d161b3-09c2-45bb-b758-9cd2d2c98873 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:54.081319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d161b3-09c2-45bb-b758-9cd2d2c98873 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:54.082056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d161b3-09c2-45bb-b758-9cd2d2c98873 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:54.083967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d161b3-09c2-45bb-b758-9cd2d2c98873 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:54.267638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 30/61] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:07:53 2022] POST /identity/v3/users => generated 275 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:07:57.532336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0114e3b-4a7a-43e7-9d3b-0179e9546e44 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:57.533350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0114e3b-4a7a-43e7-9d3b-0179e9546e44 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:57.533796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0114e3b-4a7a-43e7-9d3b-0179e9546e44 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:57.535300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 32/62] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:57.542816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc7e7e-485e-4fcb-842f-90d0200eeb26 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:57.543316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc7e7e-485e-4fcb-842f-90d0200eeb26 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:57.543544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc7e7e-485e-4fcb-842f-90d0200eeb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:57.565735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-edcc7e7e-485e-4fcb-842f-90d0200eeb26 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:57.566933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-edcc7e7e-485e-4fcb-842f-90d0200eeb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:57.663699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 31/63] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:57.734779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c09c-f77a-4f1e-bf51-2828c4f8dde3 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:57.735063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c09c-f77a-4f1e-bf51-2828c4f8dde3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:57.735498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c09c-f77a-4f1e-bf51-2828c4f8dde3 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:57.737116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 33/64] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:57.746862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd079d-7741-4eab-8117-5cbdc35fc9f8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:57.747152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd079d-7741-4eab-8117-5cbdc35fc9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:57.747419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd079d-7741-4eab-8117-5cbdc35fc9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:57.775565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-41dd079d-7741-4eab-8117-5cbdc35fc9f8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:57.776863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-41dd079d-7741-4eab-8117-5cbdc35fc9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:57.911820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 32/65] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:58.073207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c09c-f77a-4f1e-bf51-2828c4f8dde3 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:58.166249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:58.309015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c09c-f77a-4f1e-bf51-2828c4f8dde3 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:58.384346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ec823-0812-4a22-925b-8cf6105e637c None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.384678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ec823-0812-4a22-925b-8cf6105e637c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.384906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ec823-0812-4a22-925b-8cf6105e637c None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.386854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 33/66] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:58.398773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:58.399444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.399727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.399998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.400632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275e76-3fff-41ad-8361-6dc469273490 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.401142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275e76-3fff-41ad-8361-6dc469273490 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.401616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275e76-3fff-41ad-8361-6dc469273490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.428733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:58.431348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:07:58.441008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:58.447728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 34/67] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:07:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:58.449177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:58.450290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ee275e76-3fff-41ad-8361-6dc469273490 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:58.452503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ee275e76-3fff-41ad-8361-6dc469273490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:58.560906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 34/68] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:58.573085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275e76-3fff-41ad-8361-6dc469273490 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:58.615973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:58.622578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba6ce-8bf9-4aea-a1f5-9c444b4e7651 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:58.668668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717b63-79c2-4b4f-b623-4c20590961b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:58.669805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717b63-79c2-4b4f-b623-4c20590961b0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.670296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717b63-79c2-4b4f-b623-4c20590961b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.670770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717b63-79c2-4b4f-b623-4c20590961b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.685861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53717b63-79c2-4b4f-b623-4c20590961b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-53717b63-79c2-4b4f-b623-4c20590961b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:07:58.693720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:58.694626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:07:58.695722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:07:58.698697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 35/69] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:07:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:58.705721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962ebb-19f7-4e72-abad-f9fbe48204e3 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.706240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962ebb-19f7-4e72-abad-f9fbe48204e3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.706760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962ebb-19f7-4e72-abad-f9fbe48204e3 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.708806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 36/70] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:58.711484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365419f-7d89-42e3-b247-9ec21b2158eb None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.712194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365419f-7d89-42e3-b247-9ec21b2158eb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.712709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365419f-7d89-42e3-b247-9ec21b2158eb None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.715022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 37/71] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:07:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:07:58.716219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365419f-7d89-42e3-b247-9ec21b2158eb None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:58.776745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275e76-3fff-41ad-8361-6dc469273490 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:58.824266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46480e9b-6e7e-4c96-9bf2-c66c37223a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:58.824894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480e9b-6e7e-4c96-9bf2-c66c37223a6f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.825271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480e9b-6e7e-4c96-9bf2-c66c37223a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.825522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480e9b-6e7e-4c96-9bf2-c66c37223a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.826411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46480e9b-6e7e-4c96-9bf2-c66c37223a6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:58.826708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46480e9b-6e7e-4c96-9bf2-c66c37223a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:58.831554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46480e9b-6e7e-4c96-9bf2-c66c37223a6f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:58.838406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:58.846329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 35/72] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:07:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:58.852209 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46ad3-a0e3-49b6-bcee-3a5f512b5484 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.852589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46ad3-a0e3-49b6-bcee-3a5f512b5484 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.853021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46ad3-a0e3-49b6-bcee-3a5f512b5484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.866122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365419f-7d89-42e3-b247-9ec21b2158eb None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:58.878017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-d8a46ad3-a0e3-49b6-bcee-3a5f512b5484 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:58.879253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d8a46ad3-a0e3-49b6-bcee-3a5f512b5484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:58.909979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497cf8-c5d2-47e2-a314-ac230fd324e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:58.910594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497cf8-c5d2-47e2-a314-ac230fd324e4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.910876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497cf8-c5d2-47e2-a314-ac230fd324e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.911149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497cf8-c5d2-47e2-a314-ac230fd324e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.911822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497cf8-c5d2-47e2-a314-ac230fd324e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:58.912921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497cf8-c5d2-47e2-a314-ac230fd324e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:58.914404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497cf8-c5d2-47e2-a314-ac230fd324e4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:58.923748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 38/73] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:07:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:58.924941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca005b7-954e-4e3b-a8bd-fcb6ddf19ba6 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:58.925319 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca005b7-954e-4e3b-a8bd-fcb6ddf19ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:58.925637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca005b7-954e-4e3b-a8bd-fcb6ddf19ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:58.945554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1ca005b7-954e-4e3b-a8bd-fcb6ddf19ba6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:07:58.946788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1ca005b7-954e-4e3b-a8bd-fcb6ddf19ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:07:58.960600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:58.978501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 36/74] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:58.979654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46ad3-a0e3-49b6-bcee-3a5f512b5484 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.036833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 39/75] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:07:59.038135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca005b7-954e-4e3b-a8bd-fcb6ddf19ba6 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.142064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46ad3-a0e3-49b6-bcee-3a5f512b5484 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:59.176527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:59.187239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:59.192653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:59.192653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:59.192653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:59.195130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca005b7-954e-4e3b-a8bd-fcb6ddf19ba6 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:59.210488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:59.212433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:59.215071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 37/76] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:07:58 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:59.216657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.261388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:59.261388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:59.261728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:59.261895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:59.277563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:07:59.283162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:59.284391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 40/77] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:59.291345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.300445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:59.379609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d97a8-9a2a-42fc-a769-13fff3a255a0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:59.429687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe273-bf2a-4b02-93c8-13e22b8e0af2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:59.436550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:59.437578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:59.438011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:59.438409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] PATH_INFO: `/v3/users/0a6a88d51a2749349d397dd703210284` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:59.440175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] RBAC: Authorizing `identity:get_user(user_id=0a6a88d51a2749349d397dd703210284)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:59.442813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:59.451526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 38/78] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/users/0a6a88d51a2749349d397dd703210284 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:59.451526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.471336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:59.471903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:59.472294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:59.472482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:59.515771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:59.558335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:59.559809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:59.568695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:59.570756 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8edfce-3258-4dd2-b7f8-77e3685dc32e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:59.610588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:59.611198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:59.611486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:59.611749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:59.612416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:07:59.612720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:59.614120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:59.633127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 39/79] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:59.634070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.701838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 41/80] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:07:59.702807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.761399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c9ee-6288-41cd-bbff-c95fc5c05da2 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:59.778036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:59.800479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:59.801153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:59.801429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:59.801701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:59.816161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:07:59.821599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:07:59.822517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:07:59.823277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 40/81] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:07:59.823882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.834437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243ce3-a457-42cb-9a8a-c3d6c32b97b8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:07:59.847494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:07:59.882604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:07:59.883261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:07:59.883541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:07:59.883812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:07:59.885091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:07:59.886564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:07:59.888133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 42/82] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:07:59.889129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:07:59.948244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1aea6-5a2f-45d2-83cd-d4ff1ed32563 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.001829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.002485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.002860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.003041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.010542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3bb9-7912-410f-a311-0b3e50e7701d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.053586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.053893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.054173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.054448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.055634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.057115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.058740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:00.058901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 43/83] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:00.059713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:00.088236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.089776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.121470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:00.183759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571b27d-443a-40d4-901d-594a032fb409 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.223830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 41/84] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:00.224056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.224567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.224840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.225146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.225314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:00.226321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.227875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.229747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 44/85] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:00 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:00.230425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:00.322157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:00.355789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37b356-eb44-4fc9-995f-77fdfbcf697f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.363601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd8f52-0ae4-43c8-906a-79c00f44d9e0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.369167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:00.394121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.394755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.396395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.396395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.396395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.397715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.403706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.404337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.404709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.404990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.405726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:00.406042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.407594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.418821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 42/86] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:00.419700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:00.530442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef21b-21ef-459f-9ef1-17eba92a85f6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.546126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 45/87] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:00 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:00.547345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:00.582007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.582726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.582944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.583227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.592441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:00.678012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.679581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.695343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4a16-2c73-4295-a0b2-a3d521478680 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.740853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.741962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.742436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.742721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.743977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.745606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.752659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 46/88] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:00 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:00.752659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:00.806528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:00.822557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 43/89] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:00.828368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:00.880709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:00.945218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682a66f-49b6-46f2-994e-2aa70983751d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.963783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c60d2-2c9f-47ea-a5aa-984445e40f24 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:00.986037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:00.986667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:00.986954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:00.987235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:00.987986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=f0e81dc5c0fe4082a7bb24f0f9f50011) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:00.988359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:00.990074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:00.996793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 47/90] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:00 2022] GET /identity/v3/role_assignments?user.id=f0e81dc5c0fe4082a7bb24f0f9f50011&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:00.997800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:01.008053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:01.009142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:01.009652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:01.010164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:01.011785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:01.013711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:01.015731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 44/91] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:00 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:01.016784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:01.121174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:01.125869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1971-1717-4b0e-8544-6386f8a2aa70 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:01.150810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35cfc0-669a-4573-90d2-a6262d2fe48f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:01.154441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:01.171607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:01.172236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:01.172723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:01.173281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:01.174669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=0a6a88d51a2749349d397dd703210284) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:01.175086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:01.177530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:01.185248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 48/92] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:00 2022] GET /identity/v3/role_assignments?user.id=0a6a88d51a2749349d397dd703210284&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:01.186383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:01.199432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:01.201161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:01.201997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:01.202823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:01.205523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:01.208385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:01.211948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 45/93] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:01 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:01.222501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:01.326103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3508-f192-4cff-ac48-6c5b9ed50041 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:01.397662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:01.398214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:01.398500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:01.398782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:01.477296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:01.512627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9272-943b-4ca0-ab5c-b76d5caba64f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:01.536415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:01.538738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:01.654537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:01.655497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:01.655886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:01.656363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:01.657740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] RBAC: Adding query filter params (role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=f0e81dc5c0fe4082a7bb24f0f9f50011) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:01.658288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:01.660925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:01.666627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 49/94] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:01.672493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:01.684137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 46/95] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:01 2022] GET /identity/v3/role_assignments?user.id=f0e81dc5c0fe4082a7bb24f0f9f50011&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 259 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:01.786249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:01.857136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f67f5-f1a9-4cda-9423-0cca2fef0469 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:01.928078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577b1b6-5b09-4dad-b76f-ff1d923b2f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:01.928634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b1b6-5b09-4dad-b76f-ff1d923b2f20 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:01.928917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b1b6-5b09-4dad-b76f-ff1d923b2f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:01.929395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b1b6-5b09-4dad-b76f-ff1d923b2f20 None admin] PATH_INFO: `/v3/projects/d148c8c6d2c1476e86e383376d6fdb34` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:01.930661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577b1b6-5b09-4dad-b76f-ff1d923b2f20 None admin] RBAC: Authorizing `identity:get_project(project_id=d148c8c6d2c1476e86e383376d6fdb34)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:01.932219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577b1b6-5b09-4dad-b76f-ff1d923b2f20 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:01.934193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 50/96] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:01 2022] GET /identity/v3/projects/d148c8c6d2c1476e86e383376d6fdb34 => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:01.941466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:02.038964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:02.203568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755354b9-c492-49e2-ac82-ecc5888dc0da None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:02.278282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8b7e5-82c2-4390-8b92-4e0ae587e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:02.279265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8b7e5-82c2-4390-8b92-4e0ae587e0ce None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:02.279752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8b7e5-82c2-4390-8b92-4e0ae587e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:02.280227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8b7e5-82c2-4390-8b92-4e0ae587e0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:02.281580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8b7e5-82c2-4390-8b92-4e0ae587e0ce None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=d148c8c6d2c1476e86e383376d6fdb34, user.id=f0e81dc5c0fe4082a7bb24f0f9f50011) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:02.282125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8b7e5-82c2-4390-8b92-4e0ae587e0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:02.284734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8b7e5-82c2-4390-8b92-4e0ae587e0ce None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:02.300424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 47/97] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:01 2022] GET /identity/v3/role_assignments?user.id=f0e81dc5c0fe4082a7bb24f0f9f50011&scope.project.id=d148c8c6d2c1476e86e383376d6fdb34&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:04.008391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc04c3-bbc1-48e5-af2c-cc4ce6b713a5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:04.009250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc04c3-bbc1-48e5-af2c-cc4ce6b713a5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:04.009376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc04c3-bbc1-48e5-af2c-cc4ce6b713a5 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:04.011739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 51/98] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:04.021708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaae0b-8db4-4371-b505-4f80e6fcc533 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:04.022517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaae0b-8db4-4371-b505-4f80e6fcc533 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:04.022517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaae0b-8db4-4371-b505-4f80e6fcc533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:04.058576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8beaae0b-8db4-4371-b505-4f80e6fcc533 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:04.060464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8beaae0b-8db4-4371-b505-4f80e6fcc533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:04.182286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 48/99] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:04.408454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39255-2b4f-4ffe-9722-a5cd5e848411 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:04.409159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39255-2b4f-4ffe-9722-a5cd5e848411 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:04.409650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39255-2b4f-4ffe-9722-a5cd5e848411 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:04.411271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 52/100] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:08:04.417323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955630-1200-4941-b68b-66eb8f56eee4 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:04.417994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955630-1200-4941-b68b-66eb8f56eee4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:04.418520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955630-1200-4941-b68b-66eb8f56eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:04.443873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1f955630-1200-4941-b68b-66eb8f56eee4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:04.445490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1f955630-1200-4941-b68b-66eb8f56eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:04.482998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:04.584892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 49/101] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:04.914248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39255-2b4f-4ffe-9722-a5cd5e848411 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:05.053294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85de295-7b7a-47ad-9af1-d944a3917181 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.054103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85de295-7b7a-47ad-9af1-d944a3917181 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.054232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85de295-7b7a-47ad-9af1-d944a3917181 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.056438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 50/102] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:08:05.064314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703055-9651-40e3-9323-aa021a7f4c00 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.064647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703055-9651-40e3-9323-aa021a7f4c00 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.064867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703055-9651-40e3-9323-aa021a7f4c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.071682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39255-2b4f-4ffe-9722-a5cd5e848411 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:05.101495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5b703055-9651-40e3-9323-aa021a7f4c00 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:05.102708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5b703055-9651-40e3-9323-aa021a7f4c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:05.139277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:05.148921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:05.149643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.149936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.151226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.153235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:05.154811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:05.158830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 53/103] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:05.168492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:05.252558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 51/104] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:05.253436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b703055-9651-40e3-9323-aa021a7f4c00 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:05.393828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad8d73-f651-4a78-b857-40bd252aabae None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:05.455572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204c09a-8c64-4c29-bbf5-41a94417d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:05.456231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204c09a-8c64-4c29-bbf5-41a94417d5ed None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.456506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204c09a-8c64-4c29-bbf5-41a94417d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.456947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204c09a-8c64-4c29-bbf5-41a94417d5ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.469991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204c09a-8c64-4c29-bbf5-41a94417d5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-5204c09a-8c64-4c29-bbf5-41a94417d5ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:05.476485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:05.477539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:05.478401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:05.480308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 54/105] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:05.482612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:05.487678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917c2c-b3de-4123-ad65-107742a413ff None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.488143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917c2c-b3de-4123-ad65-107742a413ff None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.488618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917c2c-b3de-4123-ad65-107742a413ff None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.490702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 55/106] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:05.492017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23bee6-941a-48bb-9909-6c164195aa42 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.492434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23bee6-941a-48bb-9909-6c164195aa42 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.492836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23bee6-941a-48bb-9909-6c164195aa42 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.494556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 56/107] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:05.499559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23bee6-941a-48bb-9909-6c164195aa42 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:05.506251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b703055-9651-40e3-9323-aa021a7f4c00 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:05.556181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1280f-3240-43db-8222-159a8e70dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:05.556802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1280f-3240-43db-8222-159a8e70dfd9 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.557296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1280f-3240-43db-8222-159a8e70dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.557728 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1280f-3240-43db-8222-159a8e70dfd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.558533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1280f-3240-43db-8222-159a8e70dfd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:05.560138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1280f-3240-43db-8222-159a8e70dfd9 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:05.605856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:05.669493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 52/108] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:08:05 2022] POST /identity/v3/projects => generated 302 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:05.671394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f282-9369-474e-b31b-5a53ff556c37 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.671901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f282-9369-474e-b31b-5a53ff556c37 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.672387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f282-9369-474e-b31b-5a53ff556c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.691721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23bee6-941a-48bb-9909-6c164195aa42 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:05.701390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-eda3f282-9369-474e-b31b-5a53ff556c37 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:05.705020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-eda3f282-9369-474e-b31b-5a53ff556c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:05.797777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 53/109] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:05.799803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbc59-56ea-4e25-8ff0-96011e6fb73c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.800297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbc59-56ea-4e25-8ff0-96011e6fb73c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.800819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbc59-56ea-4e25-8ff0-96011e6fb73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.824802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-294cbc59-56ea-4e25-8ff0-96011e6fb73c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:05.826426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-294cbc59-56ea-4e25-8ff0-96011e6fb73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:05.831256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:05.832404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:05.832831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:05.833290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:05.834351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:05.834787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:05.837300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:05.873501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 57/110] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:05.875101 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:05.930981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 54/111] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:05.938064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cbc59-56ea-4e25-8ff0-96011e6fb73c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:05.940999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:06.097498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e9e6-6a47-4346-8332-9f3169576ffa None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:06.139552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cbc59-56ea-4e25-8ff0-96011e6fb73c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:06.142915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:06.187871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323de51-05ec-460c-b6d1-706d01d7d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:06.188437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323de51-05ec-460c-b6d1-706d01d7d012 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.188718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323de51-05ec-460c-b6d1-706d01d7d012 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.189026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323de51-05ec-460c-b6d1-706d01d7d012 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.211004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323de51-05ec-460c-b6d1-706d01d7d012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-4323de51-05ec-460c-b6d1-706d01d7d012 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:06.218748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:06.220243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 58/112] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:06.221693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3b055-40f3-43d0-81ee-bbedc64115e6 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.223117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3b055-40f3-43d0-81ee-bbedc64115e6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.223117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3b055-40f3-43d0-81ee-bbedc64115e6 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.224149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 59/113] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:06.230526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5242a-e903-4e22-be31-3023e597bfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:06.231967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5242a-e903-4e22-be31-3023e597bfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.232446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3b055-40f3-43d0-81ee-bbedc64115e6 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:06.233812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5242a-e903-4e22-be31-3023e597bfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.235207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5242a-e903-4e22-be31-3023e597bfa7 None admin] PATH_INFO: `/v3/users/3271970d855a40c0b2872205b770d63c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.280081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5242a-e903-4e22-be31-3023e597bfa7 None admin] RBAC: Authorizing `identity:get_user(user_id=3271970d855a40c0b2872205b770d63c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:06.282860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5242a-e903-4e22-be31-3023e597bfa7 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:06.285719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 55/114] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:05 2022] GET /identity/v3/users/3271970d855a40c0b2872205b770d63c => generated 289 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:06.287845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff39c-a2a2-4652-a172-368e3720d719 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.288619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff39c-a2a2-4652-a172-368e3720d719 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.289318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff39c-a2a2-4652-a172-368e3720d719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.312077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-62fff39c-a2a2-4652-a172-368e3720d719 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:06.313307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-62fff39c-a2a2-4652-a172-368e3720d719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:06.385458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:06.403795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 56/115] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:06.404662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff39c-a2a2-4652-a172-368e3720d719 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:06.414450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3b055-40f3-43d0-81ee-bbedc64115e6 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:06.467932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:06.468934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.469458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.469992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.470879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:06.471466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:06.473164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:06.484029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 60/116] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:06.485283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:06.525222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff39c-a2a2-4652-a172-368e3720d719 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:06.540688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:06.577089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:06.577089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.577089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.577089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.584901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:06.591354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:06.592458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:06.593230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 57/117] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:06.593863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:06.619164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834110-2c99-42f9-a3fa-67156839bd24 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:06.660567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:06.663380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:06.664173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.664619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.665232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.716037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beba39-44bc-4250-8d7a-de8574bd4a29 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:06.756873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:06.757526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.757881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.758176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.772696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:06.772853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:06.774602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:06.782949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:06.783825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:06.784556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:06.787968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 58/118] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:06.787968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:06.826804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:06.901477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 61/119] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:06.901477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:06.932961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190c49-8784-45e1-bc4b-29f98d0aec6c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:06.949562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:06.980296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:06.980897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:06.981299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:06.981527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:06.983847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:06.984213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:06.985866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 59/120] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:06 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:06.991213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.023921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a42d1-75b4-4d66-a276-66a2a5bad37b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.064763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.065643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.066079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.066509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.067438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:07.068238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.069907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.078581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 62/121] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.079485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.087370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:07.124790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6b752-2f70-4caa-9c83-927239dfd6d1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.168550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.169361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.169817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.170267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.188353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:07.197875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:07.198773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:07.199627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 60/122] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:07.200250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.226720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f6b6-83d3-444b-8571-bad2c976640c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.256621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:07.274500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.275097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.275388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.275703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.276636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:07.276965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.278395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.287057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 63/123] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.287057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.338008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b120a-0de6-4cb0-8b8f-de1c4ab67c7b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.379132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.379436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:07.380022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.380821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.381125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.382270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.383740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.385591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 61/124] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.391142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.443481 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47888-13eb-4a2b-82cc-400974ce7be0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.481353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.481922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.482203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.482480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.483645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.485124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.487037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 64/125] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.487607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.529340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0931-32e1-4bea-93ed-e990136a83e5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.537385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:07.571519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.572457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.572913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.573226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] PATH_INFO: `/v3/users/0a6a88d51a2749349d397dd703210284` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.574513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] RBAC: Authorizing `identity:get_user(user_id=0a6a88d51a2749349d397dd703210284)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.575975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.577880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 62/126] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/users/0a6a88d51a2749349d397dd703210284 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.581922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.607848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8182a45-b444-4d40-819e-f910680b89e3 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.649217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.649897 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.650147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.650394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.651064 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] RBAC: Adding query filter params (name=member) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:07.651373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.653234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.659784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:07.672387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 65/127] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.672387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.715476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008755-8bae-4d25-bceb-bf343a6e5bfe None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.754844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.756157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.756433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.756701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.757905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.759405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.761173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 63/128] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.766099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.795704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da4895-2093-4f2f-8eab-1f13d7b5d350 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.821387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:07.837115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.838949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.838949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.838949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.839407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] RBAC: Adding query filter params (role.id=9322053026b1462eab80ec804372705b, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=3271970d855a40c0b2872205b770d63c) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:07.839673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.841202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:07.847554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 66/129] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/role_assignments?user.id=3271970d855a40c0b2872205b770d63c&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=9322053026b1462eab80ec804372705b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:07.848306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:07.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b773-e106-4549-a4cf-768a1df77e3f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:07.952065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:07.956973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:07.958051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:07.959119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:07.959505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/f0e81dc5c0fe4082a7bb24f0f9f50011/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:07.962700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1451db3bbc14b4fa50d8499a2de18b8, user_id=f0e81dc5c0fe4082a7bb24f0f9f50011, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:07.965529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:08.012667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09cae-2eb3-4aee-ab9f-b56099388514 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:08.071612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:08.072638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.073141 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.073608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.075158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:08.076892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:08.078194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 64/130] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:07 2022] PUT /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/f0e81dc5c0fe4082a7bb24f0f9f50011/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:08.079444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 67/131] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:07 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:08.080551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:08.086587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:08.256079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0eb77-3ecf-4983-936c-06f6cd11cd3e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:08.281394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d608e16-be0e-49e9-b76d-9a90e23d8dc4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:08.283114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:08.296711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:08.310615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:08.311261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.311541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.311867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.313183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:08.314988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:08.316919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 68/132] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:08 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:08.321295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:08.335105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7dd2f-6712-4ba0-9ca2-7f7124344702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:08.336137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd2f-6712-4ba0-9ca2-7f7124344702 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.338074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd2f-6712-4ba0-9ca2-7f7124344702 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.338074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd2f-6712-4ba0-9ca2-7f7124344702 None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.339156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7dd2f-6712-4ba0-9ca2-7f7124344702 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:08.341337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7dd2f-6712-4ba0-9ca2-7f7124344702 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:08.344028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 65/133] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:08 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:08.347270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b68e8-d46f-4b39-8cd6-8d7a24b26cf3 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.347998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b68e8-d46f-4b39-8cd6-8d7a24b26cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.348830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b68e8-d46f-4b39-8cd6-8d7a24b26cf3 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.352479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 66/134] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:08.353457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b68e8-d46f-4b39-8cd6-8d7a24b26cf3 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:08.443301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecce12-6ca6-47a6-a86d-adf686b83f3a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:08.482674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b68e8-d46f-4b39-8cd6-8d7a24b26cf3 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:08.490088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:08.492000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.493237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.493975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/0a6a88d51a2749349d397dd703210284/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.498851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1451db3bbc14b4fa50d8499a2de18b8, user_id=0a6a88d51a2749349d397dd703210284, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:08.501032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:08.527052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d970f9c-9da4-4d52-911d-8d3922d2f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:08.527722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d970f9c-9da4-4d52-911d-8d3922d2f030 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.528006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d970f9c-9da4-4d52-911d-8d3922d2f030 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.528276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d970f9c-9da4-4d52-911d-8d3922d2f030 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/f0e81dc5c0fe4082a7bb24f0f9f50011/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.530495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d970f9c-9da4-4d52-911d-8d3922d2f030 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1451db3bbc14b4fa50d8499a2de18b8, user_id=f0e81dc5c0fe4082a7bb24f0f9f50011, role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:08.531999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d970f9c-9da4-4d52-911d-8d3922d2f030 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:08.654742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 69/135] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:08 2022] PUT /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/0a6a88d51a2749349d397dd703210284/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:08.655917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:08.703642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 67/136] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:08 2022] PUT /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/f0e81dc5c0fe4082a7bb24f0f9f50011/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:08.706665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c701-2d94-44b8-90f9-f037a2aa7d14 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.707952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c701-2d94-44b8-90f9-f037a2aa7d14 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.708655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c701-2d94-44b8-90f9-f037a2aa7d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.745386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b952c701-2d94-44b8-90f9-f037a2aa7d14 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:08.748244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b952c701-2d94-44b8-90f9-f037a2aa7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:08.766148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:08.808317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:08.873901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3d1f-cf64-4875-9d30-0a09b0d55715 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:08.902025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 68/137] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:08.942423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:08.943550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:08.944003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:08.944440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] PATH_INFO: `/v3/projects/d148c8c6d2c1476e86e383376d6fdb34` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:08.948697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=d148c8c6d2c1476e86e383376d6fdb34)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:08.950785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:08.952810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 70/138] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:08 2022] GET /identity/v3/projects/d148c8c6d2c1476e86e383376d6fdb34 => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:08.959626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952c701-2d94-44b8-90f9-f037a2aa7d14 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:09.102211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952c701-2d94-44b8-90f9-f037a2aa7d14 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:09.150130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:09.151152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:09.151658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:09.152135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] PATH_INFO: `/v3/projects/d148c8c6d2c1476e86e383376d6fdb34/users/f0e81dc5c0fe4082a7bb24f0f9f50011/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:09.158859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] RBAC: Authorizing `identity:create_grant(project_id=d148c8c6d2c1476e86e383376d6fdb34, user_id=f0e81dc5c0fe4082a7bb24f0f9f50011, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:09.160845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:09.328982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 69/139] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:08 2022] PUT /identity/v3/projects/d148c8c6d2c1476e86e383376d6fdb34/users/f0e81dc5c0fe4082a7bb24f0f9f50011/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:08:09.376900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:09.508433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb924-a98a-4c7f-84b7-e8bbfabb9bb2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:09.540686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:09.559913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cfcea-e4b4-464d-9ae2-78668d3fede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:09.560939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cfcea-e4b4-464d-9ae2-78668d3fede2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:09.561546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cfcea-e4b4-464d-9ae2-78668d3fede2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:09.562019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cfcea-e4b4-464d-9ae2-78668d3fede2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:09.565985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cfcea-e4b4-464d-9ae2-78668d3fede2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:09.568144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cfcea-e4b4-464d-9ae2-78668d3fede2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:09.570508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 71/140] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:09.576031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:09.602787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:09.712357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1842-c372-4677-ab4f-a6b2ebc9c22d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:09.753733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65ea6a-85cd-47c6-9080-405b554d54a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:09.754779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ea6a-85cd-47c6-9080-405b554d54a3 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:09.755339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ea6a-85cd-47c6-9080-405b554d54a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:09.755829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ea6a-85cd-47c6-9080-405b554d54a3 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:09.756702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65ea6a-85cd-47c6-9080-405b554d54a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:09.758469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65ea6a-85cd-47c6-9080-405b554d54a3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:09.949410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 70/141] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:09 2022] POST /identity/v3/users => generated 283 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:08:10.357652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca004c-83d3-4f47-b1ee-bdbc701581d1 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:10.358325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca004c-83d3-4f47-b1ee-bdbc701581d1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:10.358807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca004c-83d3-4f47-b1ee-bdbc701581d1 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:10.360594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 72/142] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:10.367057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372eda8-65b5-4748-8f33-f9e4556369d9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:10.367962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372eda8-65b5-4748-8f33-f9e4556369d9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:10.368435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372eda8-65b5-4748-8f33-f9e4556369d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:10.390886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2372eda8-65b5-4748-8f33-f9e4556369d9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:10.392519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2372eda8-65b5-4748-8f33-f9e4556369d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:10.488940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 71/143] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:10.664978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cc071-c591-4386-93be-a97056bbd5e3 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:10.665783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cc071-c591-4386-93be-a97056bbd5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:10.665783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cc071-c591-4386-93be-a97056bbd5e3 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:10.667750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 73/144] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:10.678311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9d8f-d5dc-4973-bd9c-49ad6686bf0c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:10.678665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9d8f-d5dc-4973-bd9c-49ad6686bf0c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:10.678860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9d8f-d5dc-4973-bd9c-49ad6686bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:10.696299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:10.704156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-fa4a9d8f-d5dc-4973-bd9c-49ad6686bf0c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:10.705428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-fa4a9d8f-d5dc-4973-bd9c-49ad6686bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:10.794682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 72/145] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:11.041665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cc071-c591-4386-93be-a97056bbd5e3 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:11.119699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9d8f-d5dc-4973-bd9c-49ad6686bf0c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:11.240417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cc071-c591-4386-93be-a97056bbd5e3 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:11.319864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:11.319864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:11.319864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:11.319864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:11.338018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9d8f-d5dc-4973-bd9c-49ad6686bf0c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:11.340150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:11.345494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:11.346511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:11.347458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:11.353610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 74/146] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:11.359614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:11.394423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:11.395205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:11.395621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:11.395966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:11.405692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:11.418912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:11.426497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:11.427912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:11.428653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 73/147] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:08:11.435043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:11.436914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:11.492997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95115ae-6da9-4daf-9d57-6775221267c1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:11.533733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07fff-d2ed-40e6-be3c-17e021a0b17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:11.534621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07fff-d2ed-40e6-be3c-17e021a0b17c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:11.535042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07fff-d2ed-40e6-be3c-17e021a0b17c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:11.535457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07fff-d2ed-40e6-be3c-17e021a0b17c None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:11.536811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07fff-d2ed-40e6-be3c-17e021a0b17c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:11.537278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07fff-d2ed-40e6-be3c-17e021a0b17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:11.538873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07fff-d2ed-40e6-be3c-17e021a0b17c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:11.553649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 75/148] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:11.555191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd071-3648-4008-94de-eb8f1beefda9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:11.555621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd071-3648-4008-94de-eb8f1beefda9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:11.556043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd071-3648-4008-94de-eb8f1beefda9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:11.557594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 76/149] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:11.563184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea313-046c-4477-a6be-6e97eef40687 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:11.563739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea313-046c-4477-a6be-6e97eef40687 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:11.564188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea313-046c-4477-a6be-6e97eef40687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:11.584476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0e7e-a058-48b1-ba1c-454de5c8437d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:11.592361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-9a8ea313-046c-4477-a6be-6e97eef40687 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:11.593925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9a8ea313-046c-4477-a6be-6e97eef40687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:11.635100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:11.635754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:11.636392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:11.636683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:11.639038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:11.639359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:11.640803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:11.662365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 74/150] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:11.663391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:11.728279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 77/151] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:11.729224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ea313-046c-4477-a6be-6e97eef40687 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:11.793517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:11.847727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90470b9f-50f8-4c16-bdd6-599ea73a3faf None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:11.877423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:11.900050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:11.900919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:11.901260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:11.901563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] PATH_INFO: `/v3/users/3271970d855a40c0b2872205b770d63c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:11.902750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] RBAC: Authorizing `identity:get_user(user_id=3271970d855a40c0b2872205b770d63c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:11.904381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:11.906573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 75/152] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:11 2022] GET /identity/v3/users/3271970d855a40c0b2872205b770d63c => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:11.914520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:11.962183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ea313-046c-4477-a6be-6e97eef40687 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:12.017817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:12.018480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.018762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.019100 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.020960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:12.022444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:12.025370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 78/153] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:11 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:12.030258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:12.039446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a0729-6a15-4a7b-aecc-620d4db97664 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:12.068364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:12.081818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:12.082731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.084442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.084442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.085728 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:12.087510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:12.089844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 76/154] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:11 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:12.095921 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:12.172539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386e003-6d1a-4d25-811a-79ceb66644cb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:12.213457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:12.242392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:12.243015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.243294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.243565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.248419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2dcf-7a87-4e52-b588-09c00ed999c9 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:12.305496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e50d4-d4f7-4e2a-80af-43855e7ddfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:12.306411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e50d4-d4f7-4e2a-80af-43855e7ddfe8 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.306702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e50d4-d4f7-4e2a-80af-43855e7ddfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.306983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e50d4-d4f7-4e2a-80af-43855e7ddfe8 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/3271970d855a40c0b2872205b770d63c/roles/9322053026b1462eab80ec804372705b` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.309211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e50d4-d4f7-4e2a-80af-43855e7ddfe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1451db3bbc14b4fa50d8499a2de18b8, user_id=3271970d855a40c0b2872205b770d63c, role_id=9322053026b1462eab80ec804372705b)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:12.311120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e50d4-d4f7-4e2a-80af-43855e7ddfe8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:12.357175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:12.358651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:12.394242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 77/155] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:12 2022] PUT /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/users/3271970d855a40c0b2872205b770d63c/roles/9322053026b1462eab80ec804372705b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:08:12.398535 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c14da-4f11-4e57-8be3-178d785980a4 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.399131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c14da-4f11-4e57-8be3-178d785980a4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.399131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c14da-4f11-4e57-8be3-178d785980a4 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.401001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 78/156] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:12.407025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce027fc-3ea1-44a2-a8d8-92e52ce62b28 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.407319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce027fc-3ea1-44a2-a8d8-92e52ce62b28 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.407597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce027fc-3ea1-44a2-a8d8-92e52ce62b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.442746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6ce027fc-3ea1-44a2-a8d8-92e52ce62b28 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:12.444077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6ce027fc-3ea1-44a2-a8d8-92e52ce62b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:12.508871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 79/157] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:08:12.512769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:12.536730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:12.547189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:12.598935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 79/158] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:12.602768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce027fc-3ea1-44a2-a8d8-92e52ce62b28 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:12.749083 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc545-961d-4945-8f8c-f30436fd3cca None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:12.789784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce027fc-3ea1-44a2-a8d8-92e52ce62b28 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:12.871033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:12.871232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:12.871830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.872107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.872374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.872640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:12.873104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:12.873566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:12.876644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:12.878616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:12.881302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 80/159] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:12 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:12.887212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:12.894186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:12.899452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:12.900435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:12.905450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:12.907775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 80/160] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:12.918356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:12.997799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:13.070180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:13.088274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deeb9ff-8eec-4afc-b136-0c5044925eb8 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:13.123352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9dc83-a0c9-494c-9574-f1e3a3fd3fd2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:13.149771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f0fb9-361d-4006-9585-3d1457cd2020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:13.150798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0fb9-361d-4006-9585-3d1457cd2020 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:13.152341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0fb9-361d-4006-9585-3d1457cd2020 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:13.152940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0fb9-361d-4006-9585-3d1457cd2020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:13.154534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f0fb9-361d-4006-9585-3d1457cd2020 None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=f0e81dc5c0fe4082a7bb24f0f9f50011) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:13.155184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f0fb9-361d-4006-9585-3d1457cd2020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:13.159460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f0fb9-361d-4006-9585-3d1457cd2020 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:13.170206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 81/161] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:12 2022] GET /identity/v3/role_assignments?user.id=f0e81dc5c0fe4082a7bb24f0f9f50011&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:13.171822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ef26-39ac-497d-ae8f-ad2930dfd02f None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:13.173464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ef26-39ac-497d-ae8f-ad2930dfd02f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:13.174699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ef26-39ac-497d-ae8f-ad2930dfd02f None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:13.177578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 82/162] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:13.186113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207b23-1152-4f69-b1a5-17017aff41aa None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:13.186749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207b23-1152-4f69-b1a5-17017aff41aa None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:13.187263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207b23-1152-4f69-b1a5-17017aff41aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:13.196767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:13.202216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:13.202843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:13.203317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:13.204257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:13.204767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:13.207911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:13.216145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6f207b23-1152-4f69-b1a5-17017aff41aa None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:13.220758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6f207b23-1152-4f69-b1a5-17017aff41aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:13.227015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 81/163] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:13.232670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:13.365392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 83/164] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:13.366093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f207b23-1152-4f69-b1a5-17017aff41aa None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:13.442709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:13.460072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928975-d5b7-4f9b-98d8-3533890af16f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:13.518249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:13.519312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:13.519795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:13.520817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] PATH_INFO: `/v3/users/0a6a88d51a2749349d397dd703210284` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:13.523352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] RBAC: Authorizing `identity:get_user(user_id=0a6a88d51a2749349d397dd703210284)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:13.525803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:13.528742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 82/165] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:13 2022] GET /identity/v3/users/0a6a88d51a2749349d397dd703210284 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:13.537875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:13.545394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:13.557104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f207b23-1152-4f69-b1a5-17017aff41aa None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:13.657870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:13.658443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:13.658721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:13.658989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:13.687953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6a8a2-dbcb-44d5-bf73-1afeb92e6e96 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:13.697939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:13.702848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:13.703721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:13.705080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 84/166] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:13.712404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:13.741823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:13.742452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:13.742779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:13.743059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:13.838820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:13.840310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:13.852748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:13.961116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33f71-e5bb-4f34-8e0b-342b7630833e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:13.975582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:14.015356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:14.015981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.016259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.016636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.017345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:14.017647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:14.019052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:14.031172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 83/167] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:08:14.032090 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:14.034947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 85/168] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:14.042125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:14.241361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07239e-15c2-4c6f-8e28-82833c4c4cce None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:14.319759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554402-f04e-4235-ae75-73307ff5f386 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:14.322719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:14.342831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:14.343484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.343759 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.344032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.349763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:14.351225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:14.352881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 86/169] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:14 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:14.353713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:14.399688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:14.400342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.400623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.400896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.420286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:14.429818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:14.430755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:14.431642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 84/170] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:14.432750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:14.433824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:14.537965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ee95-8158-481f-b119-c560dc0aa3a0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:14.588847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a5a4-8de2-431f-8903-cfb2744f3515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:14.589543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a5a4-8de2-431f-8903-cfb2744f3515 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.589825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a5a4-8de2-431f-8903-cfb2744f3515 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.590106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a5a4-8de2-431f-8903-cfb2744f3515 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.591327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a5a4-8de2-431f-8903-cfb2744f3515 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:14.593237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a5a4-8de2-431f-8903-cfb2744f3515 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:14.594928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 87/171] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:14 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:14.596092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3708215-b9f5-485a-9a5b-9aad60880f7e None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.596375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3708215-b9f5-485a-9a5b-9aad60880f7e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.596648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3708215-b9f5-485a-9a5b-9aad60880f7e None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.604598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 88/172] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:14.605693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3708215-b9f5-485a-9a5b-9aad60880f7e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:14.607244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c230f19-998b-4e88-8ba4-d1763c2756f0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:14.686403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:14.687770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.688481 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.689187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.731362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3708215-b9f5-485a-9a5b-9aad60880f7e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:14.734831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:14.756365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:14.774697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:14.775707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.776191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.776761 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.777836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:14.778343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:14.780024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:14.789322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 89/173] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:14.790469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:14.835658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:14.842872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:14.909902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e28ce4-28ea-4db2-bf7e-05978cca44f1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:14.949860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b66b6-68f3-44fb-9bd9-dc14b83c9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:14.950972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b66b6-68f3-44fb-9bd9-dc14b83c9df2 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.951553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b66b6-68f3-44fb-9bd9-dc14b83c9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.952053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b66b6-68f3-44fb-9bd9-dc14b83c9df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.953020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b66b6-68f3-44fb-9bd9-dc14b83c9df2 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=0a6a88d51a2749349d397dd703210284) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:14.953637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b66b6-68f3-44fb-9bd9-dc14b83c9df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:14.955545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b66b6-68f3-44fb-9bd9-dc14b83c9df2 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:14.962795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 90/174] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:14 2022] GET /identity/v3/role_assignments?user.id=0a6a88d51a2749349d397dd703210284&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:14.964307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406f6b-1a67-4f54-b0a9-37fc5124d9c7 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:14.964868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406f6b-1a67-4f54-b0a9-37fc5124d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:14.965467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406f6b-1a67-4f54-b0a9-37fc5124d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:14.985956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4a406f6b-1a67-4f54-b0a9-37fc5124d9c7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:14.987594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4a406f6b-1a67-4f54-b0a9-37fc5124d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:15.018576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:15.023124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 85/175] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:15.024009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:15.071644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 91/176] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:15.072836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a406f6b-1a67-4f54-b0a9-37fc5124d9c7 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:15.137606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:15.197303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b2a48-1f06-484c-9107-f609cba89876 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:15.261830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e0363-9e01-4cf1-8c1f-c95668cb9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:15.262487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e0363-9e01-4cf1-8c1f-c95668cb9250 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.262776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e0363-9e01-4cf1-8c1f-c95668cb9250 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.263215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e0363-9e01-4cf1-8c1f-c95668cb9250 None admin] PATH_INFO: `/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.264889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e0363-9e01-4cf1-8c1f-c95668cb9250 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e81dc5c0fe4082a7bb24f0f9f50011)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:15.267255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e0363-9e01-4cf1-8c1f-c95668cb9250 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:15.268855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 86/177] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:15 2022] GET /identity/v3/users/f0e81dc5c0fe4082a7bb24f0f9f50011 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:15.274496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7452552-681e-4fa8-b2ab-009e40f921a6 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.274971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7452552-681e-4fa8-b2ab-009e40f921a6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.275419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7452552-681e-4fa8-b2ab-009e40f921a6 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.276892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 87/178] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:15.282093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a406f6b-1a67-4f54-b0a9-37fc5124d9c7 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:15.287019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f203b-8fa8-48e7-8714-cc7d40d7d344 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.287303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f203b-8fa8-48e7-8714-cc7d40d7d344 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.289012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f203b-8fa8-48e7-8714-cc7d40d7d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.319044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-fa4f203b-8fa8-48e7-8714-cc7d40d7d344 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:15.320495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fa4f203b-8fa8-48e7-8714-cc7d40d7d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:15.338646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:15.339643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.340208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.340646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.342805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:15.344529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:15.346786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 92/179] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:15 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:15.347795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:15.397406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:15.418661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 88/180] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:15.425994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f203b-8fa8-48e7-8714-cc7d40d7d344 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:15.541340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0eb83-a9d2-43b9-bc75-ccdb726f6453 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:15.543887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:15.603644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679ba3-767f-40d4-a25f-b37476ceacc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:15.604531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679ba3-767f-40d4-a25f-b37476ceacc8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.605019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679ba3-767f-40d4-a25f-b37476ceacc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.605594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679ba3-767f-40d4-a25f-b37476ceacc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.618454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f203b-8fa8-48e7-8714-cc7d40d7d344 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:15.666947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:15.667607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.668004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.668284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.669156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] RBAC: Adding query filter params (role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=f0e81dc5c0fe4082a7bb24f0f9f50011) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:15.669379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:15.670941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:15.677513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 89/181] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:15 2022] GET /identity/v3/role_assignments?user.id=f0e81dc5c0fe4082a7bb24f0f9f50011&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:15.678334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:15.724280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54679ba3-767f-40d4-a25f-b37476ceacc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:15.726224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54679ba3-767f-40d4-a25f-b37476ceacc8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:15.761894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:15.860765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 93/182] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:15.862303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b9b5-4571-4105-a8ae-75ed06a67c28 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.862622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b9b5-4571-4105-a8ae-75ed06a67c28 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.862911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b9b5-4571-4105-a8ae-75ed06a67c28 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.865096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 94/183] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:15.866071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cdfa-0c9f-4b2a-a3ea-f5b58d5f28eb None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.866561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cdfa-0c9f-4b2a-a3ea-f5b58d5f28eb None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.866841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cdfa-0c9f-4b2a-a3ea-f5b58d5f28eb None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.868266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 95/184] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:15.869209 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cdfa-0c9f-4b2a-a3ea-f5b58d5f28eb None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:15.878111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f4a3-a6df-44ee-b196-38c3d2a14a93 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:15.908222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:15.929314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:15.929961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:15.930243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:15.930517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:15.947204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:15.954174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:15.955150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:15.955912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 90/185] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:15.956679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.000605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cdfa-0c9f-4b2a-a3ea-f5b58d5f28eb None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.035588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:16.044335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6439f-e7d6-44df-a708-1a91a2dcb3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.053599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6439f-e7d6-44df-a708-1a91a2dcb3ef None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.053599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6439f-e7d6-44df-a708-1a91a2dcb3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.053599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6439f-e7d6-44df-a708-1a91a2dcb3ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.053599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6439f-e7d6-44df-a708-1a91a2dcb3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:16.053599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6439f-e7d6-44df-a708-1a91a2dcb3ef None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:16.053599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 96/186] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:16.054004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa597-4698-40b0-8f4a-a41ef19e0f83 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.054004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa597-4698-40b0-8f4a-a41ef19e0f83 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.054004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa597-4698-40b0-8f4a-a41ef19e0f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.065660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b961b-ec4b-48c8-abcf-a82a9ee8f858 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.069914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-16faa597-4698-40b0-8f4a-a41ef19e0f83 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:16.071104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-16faa597-4698-40b0-8f4a-a41ef19e0f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:16.100906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f5269-262e-45ac-92d0-3e715dbc9377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.101568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5269-262e-45ac-92d0-3e715dbc9377 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.101848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5269-262e-45ac-92d0-3e715dbc9377 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.102126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5269-262e-45ac-92d0-3e715dbc9377 None admin] PATH_INFO: `/v3/projects/d148c8c6d2c1476e86e383376d6fdb34` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.103277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f5269-262e-45ac-92d0-3e715dbc9377 None admin] RBAC: Authorizing `identity:get_project(project_id=d148c8c6d2c1476e86e383376d6fdb34)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:16.104890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f5269-262e-45ac-92d0-3e715dbc9377 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:16.106579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 91/187] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:15 2022] GET /identity/v3/projects/d148c8c6d2c1476e86e383376d6fdb34 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:16.110879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062ccb-27e7-4337-b9f7-32cd0cd15f9d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.111198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062ccb-27e7-4337-b9f7-32cd0cd15f9d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.111634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062ccb-27e7-4337-b9f7-32cd0cd15f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.130695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f9062ccb-27e7-4337-b9f7-32cd0cd15f9d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:16.132133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f9062ccb-27e7-4337-b9f7-32cd0cd15f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:16.146938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 97/188] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:16.147787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faa597-4698-40b0-8f4a-a41ef19e0f83 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.192194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:16.213020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 92/189] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:16.213683 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062ccb-27e7-4337-b9f7-32cd0cd15f9d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.282071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faa597-4698-40b0-8f4a-a41ef19e0f83 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.319905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:16.332630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.332795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062ccb-27e7-4337-b9f7-32cd0cd15f9d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.333614 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.334067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.334838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.336654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:16.337191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:16.338765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:16.348889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 98/190] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:16.350143 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.373767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.374389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.375507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.375786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.376452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:16.378018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:16.458931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129256-006c-4273-954a-a29533f7ea0d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.493502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.494104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.494392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.494658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.495378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=d148c8c6d2c1476e86e383376d6fdb34, user.id=f0e81dc5c0fe4082a7bb24f0f9f50011) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:16.495780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:16.497126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:16.502721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 99/191] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:16 2022] GET /identity/v3/role_assignments?user.id=f0e81dc5c0fe4082a7bb24f0f9f50011&scope.project.id=d148c8c6d2c1476e86e383376d6fdb34&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:16.503494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.534106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 93/192] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:16 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:16.542338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.571733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:16.618241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:16.638350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deecaf-bd38-4e49-b19c-413a76071919 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.685215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.685875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.686155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.686448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] PATH_INFO: `/v3/users/8ff7898674eb469f921dcdb12c68e817` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.702860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] RBAC: Authorizing `identity:get_user(user_id=8ff7898674eb469f921dcdb12c68e817)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:16.704477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:16.706482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 100/193] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:16 2022] GET /identity/v3/users/8ff7898674eb469f921dcdb12c68e817 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:16.707100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.710122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc71a9-c22b-4795-a5d9-995c29607e3f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.760564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.761403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.761756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.762034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.776828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:16.782637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:16.783491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:16.784276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 94/194] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:16.785408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.849122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bfe5e-8c22-4b14-9419-0558cbd0e93a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.867812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:16.906404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.906404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.906404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.906404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:16.909997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:16.915758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:16.916641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:16.917433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 101/195] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:16.918094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:16.922880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:16.925956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395eb8-232e-4540-a6d7-c283e3118a07 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:16.969950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:16.970592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:16.970873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:16.971146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.056234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2cdf2-5d9f-4e28-850b-8dc80b2c9c26 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:17.062720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.064214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.109781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:17.110639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:17.110943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:17.111219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.112464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:17.112776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.114927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.126126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 102/196] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:17.127569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.173667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:17.184403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:17.191089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 95/197] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:17.193084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.284248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c28f47-50f2-4a5c-a478-b845b89375b8 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:17.316679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446685-5519-4e37-9abc-35da9b41314a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:17.331976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:17.332621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:17.333287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:17.333560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.334513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:17.334815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.337258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.348863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 103/198] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:17.350324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.355609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:17.356379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:17.356662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:17.356935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] PATH_INFO: `/v3/users/8ff7898674eb469f921dcdb12c68e817` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.358268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff7898674eb469f921dcdb12c68e817)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.359733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.361426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 96/199] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/users/8ff7898674eb469f921dcdb12c68e817 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:17.362297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.441086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:17.479709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff8aad-d052-4b99-b78a-95adb7e18aa7 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:17.485342 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:17.493767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af6e6e-ad17-40a8-9091-dabd31de5675 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:17.522581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:17.523573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:17.524075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:17.524492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] PATH_INFO: `/v3/users/3271970d855a40c0b2872205b770d63c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.525879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] RBAC: Authorizing `identity:get_user(user_id=3271970d855a40c0b2872205b770d63c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.527569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.529813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 97/200] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/users/3271970d855a40c0b2872205b770d63c => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:17.530811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.539202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:17.539843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:17.540127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:17.540403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.541578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.543615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.546191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 104/201] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:17.547031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.662292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bb4b7-75af-4dc4-9c50-27fa0ccfd8ac None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:17.672158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7760-ff55-4e6e-8cb4-789b6a29ffdb None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:17.700874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:17.701497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:17.701784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:17.702091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.704968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:17.708126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:17.708803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:17.709274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:17.709608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:17.741681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:17.776292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.777821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.779382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:17.780934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:17.894147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 105/202] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:17.897125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.913903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 98/203] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:17.914796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:17.953751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:17.977533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:18.014261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c4c2-5970-44f1-9e10-66e278081240 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:18.032243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91bce1-2639-472a-bbc9-42115a32d785 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:18.053221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:18.054217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.054727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.055189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.056111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=8ff7898674eb469f921dcdb12c68e817) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:18.056641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:18.058421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:18.069192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 106/204] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/role_assignments?user.id=8ff7898674eb469f921dcdb12c68e817&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:18.070454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:18.077103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:18.077103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.077103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.077103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.077521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:18.077521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:18.077521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 99/205] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:17 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:18.083700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:18.209025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da3122-1b83-43aa-a97c-c33847cb14df None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:18.210828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:18.230139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547b2ed-5d10-4e7b-9db5-995e03f05277 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:18.247655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:18.248335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.248539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.248818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.249581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] RBAC: Adding query filter params (role.id=9322053026b1462eab80ec804372705b, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8, user.id=3271970d855a40c0b2872205b770d63c) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:18.249888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:18.251503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:18.259521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 100/206] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:18 2022] GET /identity/v3/role_assignments?user.id=3271970d855a40c0b2872205b770d63c&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=9322053026b1462eab80ec804372705b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:18.265476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:18.272048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19152ae-87dd-41f2-b0f0-9e2a8d2138f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:18.276903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19152ae-87dd-41f2-b0f0-9e2a8d2138f8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.276903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19152ae-87dd-41f2-b0f0-9e2a8d2138f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.276903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19152ae-87dd-41f2-b0f0-9e2a8d2138f8 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.276903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19152ae-87dd-41f2-b0f0-9e2a8d2138f8 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:18.276903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19152ae-87dd-41f2-b0f0-9e2a8d2138f8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:18.278847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 107/207] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:18 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:18.285661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:18.424613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7951a-95cf-43f1-bf03-446d4c1f9c8c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:18.469332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fd1c9-8864-4b59-ae66-391965d182be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:18.469875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fd1c9-8864-4b59-ae66-391965d182be None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.470155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fd1c9-8864-4b59-ae66-391965d182be None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.470428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fd1c9-8864-4b59-ae66-391965d182be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.471247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fd1c9-8864-4b59-ae66-391965d182be None admin] RBAC: Adding query filter params (role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=8ff7898674eb469f921dcdb12c68e817) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:18.471563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fd1c9-8864-4b59-ae66-391965d182be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:18.473107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fd1c9-8864-4b59-ae66-391965d182be None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:18.480198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 101/208] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:18 2022] GET /identity/v3/role_assignments?user.id=8ff7898674eb469f921dcdb12c68e817&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:18.842653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86036-9abd-49b7-bdc3-8a5aac55863e None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.843176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86036-9abd-49b7-bdc3-8a5aac55863e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.843176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86036-9abd-49b7-bdc3-8a5aac55863e None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.844532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 108/209] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:18.851970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd7f1-275b-497d-8747-f17602b78961 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.852332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd7f1-275b-497d-8747-f17602b78961 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.852854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd7f1-275b-497d-8747-f17602b78961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.880032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a20cd7f1-275b-497d-8747-f17602b78961 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:18.881263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a20cd7f1-275b-497d-8747-f17602b78961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:18.911740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:18.966469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 102/210] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:18.985601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57f9e9-b027-4efb-84a0-5b32ccc6a5b1 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.985931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57f9e9-b027-4efb-84a0-5b32ccc6a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.986155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57f9e9-b027-4efb-84a0-5b32ccc6a5b1 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:18.987646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 109/211] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:18.993307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ea30d-20fb-47c2-a529-ccb1b3676bfc None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:18.993594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ea30d-20fb-47c2-a529-ccb1b3676bfc None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:18.993868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ea30d-20fb-47c2-a529-ccb1b3676bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:19.013372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7e8ea30d-20fb-47c2-a529-ccb1b3676bfc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:19.014564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7e8ea30d-20fb-47c2-a529-ccb1b3676bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:19.093323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 103/212] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:19.252960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57f9e9-b027-4efb-84a0-5b32ccc6a5b1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:19.363238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57f9e9-b027-4efb-84a0-5b32ccc6a5b1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:19.369301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ea30d-20fb-47c2-a529-ccb1b3676bfc None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:19.410046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:19.411676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:19.412011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:19.412345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:19.427000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:19.433807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:19.434775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:19.435598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 110/213] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:19.443360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:19.489280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:19.502867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ea30d-20fb-47c2-a529-ccb1b3676bfc None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:19.526844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:19.553593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:19.554240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:19.554516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:19.554785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:19.555996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:19.558158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:19.559459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e379b-0971-4333-a1db-8b9829d6d547 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:19.560036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 104/214] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:19.565132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:19.600791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:19.601492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:19.601774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:19.602049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:19.602714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:19.710183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:19.710183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:19.710183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 111/215] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:19.710183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:19.710640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826ad0e-8762-4a92-88ce-f5c9aee346f7 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:19.750555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:19.751211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:19.751495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:19.751769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:19.752601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:19.754791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:19.762540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1d20-4f78-46f0-9145-662f98511e30 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:19.786129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:19.804173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:19.804949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:19.805341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:19.805688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] PATH_INFO: `/v3/users/4f52d0b050594c20b467282879a6a40a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:19.819900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] RBAC: Authorizing `identity:get_user(user_id=4f52d0b050594c20b467282879a6a40a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:19.821402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:19.827808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 112/216] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:19 2022] GET /identity/v3/users/4f52d0b050594c20b467282879a6a40a => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:19.830370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:19.936075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596a7a6-f9a1-4bee-9edf-0c8117fdf56b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:19.981501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 105/217] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:19 2022] POST /identity/v3/users => generated 297 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:08:19.989712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54598c5-640e-46d1-954e-b10f2b685535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:19.990276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54598c5-640e-46d1-954e-b10f2b685535 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:19.990553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54598c5-640e-46d1-954e-b10f2b685535 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:19.990823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54598c5-640e-46d1-954e-b10f2b685535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.042957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:20.072952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54598c5-640e-46d1-954e-b10f2b685535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:20.074648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54598c5-640e-46d1-954e-b10f2b685535 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:20.189632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 113/218] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:20.196345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:20.214398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:20.308422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bbd36-d6a6-42ce-8105-a2c1552e9e21 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:20.322092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831120a-03fa-4e9a-ab49-6d9f18e1bff1 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:20.322511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831120a-03fa-4e9a-ab49-6d9f18e1bff1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:20.322648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831120a-03fa-4e9a-ab49-6d9f18e1bff1 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.324019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 114/219] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:20.329526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78478d-dfff-4579-8a2f-c06bbf98277d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:20.329810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78478d-dfff-4579-8a2f-c06bbf98277d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:20.330091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78478d-dfff-4579-8a2f-c06bbf98277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.350747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:20.351393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:20.351674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:20.351946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.352966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8e78478d-dfff-4579-8a2f-c06bbf98277d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:20.353135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:20.354531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8e78478d-dfff-4579-8a2f-c06bbf98277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:20.354778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:20.356582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 106/220] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:20 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:20.362665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:20.449704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 115/221] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:20.477884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:20.504334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903cfff-184a-4f47-827a-98526bd94190 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:20.543642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8616933-173d-4e39-83b6-3b30cbd312a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:20.544355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616933-173d-4e39-83b6-3b30cbd312a7 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:20.544665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616933-173d-4e39-83b6-3b30cbd312a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:20.544950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616933-173d-4e39-83b6-3b30cbd312a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.545759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8616933-173d-4e39-83b6-3b30cbd312a7 None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=4f52d0b050594c20b467282879a6a40a) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:20.546097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8616933-173d-4e39-83b6-3b30cbd312a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:20.547647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8616933-173d-4e39-83b6-3b30cbd312a7 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:20.557463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 107/222] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:20 2022] GET /identity/v3/role_assignments?user.id=4f52d0b050594c20b467282879a6a40a&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:20.598249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f827a-3a2e-48ef-8c0f-31ce34b41d37 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:20.598546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f827a-3a2e-48ef-8c0f-31ce34b41d37 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:20.598706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f827a-3a2e-48ef-8c0f-31ce34b41d37 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.600113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 116/223] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:20.606131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dabe25-384c-489c-9edc-8794fb4b0f36 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:20.606450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dabe25-384c-489c-9edc-8794fb4b0f36 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:20.606764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dabe25-384c-489c-9edc-8794fb4b0f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.634252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-62dabe25-384c-489c-9edc-8794fb4b0f36 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:20.635583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-62dabe25-384c-489c-9edc-8794fb4b0f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:20.733225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 108/224] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:20.745192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f827a-3a2e-48ef-8c0f-31ce34b41d37 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:20.749193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:20.855654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f827a-3a2e-48ef-8c0f-31ce34b41d37 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:20.892910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:20.902176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:20.902176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:20.902176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:20.906656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:20.911601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:20.912562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:20.913793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 117/225] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:20.918922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dabe25-384c-489c-9edc-8794fb4b0f36 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:21.048958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:21.079814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dabe25-384c-489c-9edc-8794fb4b0f36 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:21.127036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:21.127582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:21.127862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:21.128133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:21.128814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:21.129210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:21.130611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:21.143720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 109/226] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:21.149685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:21.251495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:21.252908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:21.298569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274403c-28f1-4510-bc2f-55d303f787bb None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:21.359621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:21.360293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:21.360569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:21.360840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] PATH_INFO: `/v3/users/8ff7898674eb469f921dcdb12c68e817` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:21.364883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff7898674eb469f921dcdb12c68e817)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:21.366749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:21.370140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 118/227] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:21 2022] GET /identity/v3/users/8ff7898674eb469f921dcdb12c68e817 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:21.379731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:21.410150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278002f-75ba-44af-9a18-dbf2aac1036c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:21.455052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:21.455762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:21.456043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:21.456370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:21.464941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:21.470027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:21.476590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:21.484768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:21.485651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 110/228] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:08:21.494360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:21.544759 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd504-58ec-4b4c-b183-7090c443fd21 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:21.579869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:21.586381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:21.587264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:21.587688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:21.588259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:21.589826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:21.591646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:21.593968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 119/229] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:21 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:21.603831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:21.730342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c96529-9777-477d-9e38-b4a7a58ebf43 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:21.779273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:21.780323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:21.780805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:21.781341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:21.782798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:21.783478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:21.785751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:21.796296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 111/230] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:21.803316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:21.828827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424c52e-e609-4466-8c4a-924ce85763fa None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:21.881809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:21.915474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:21.916535 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:21.917846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:21.918421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e/users/8ff7898674eb469f921dcdb12c68e817/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:21.923049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5565ecc493584acf98865b488c38a86e, user_id=8ff7898674eb469f921dcdb12c68e817, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:21.927376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:21.947536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd99b20-3bb3-43f6-b5d6-7073134e9af8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:21.989598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:21.990656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:21.991140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:21.991623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] PATH_INFO: `/v3/users/8ff7898674eb469f921dcdb12c68e817` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:21.993126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff7898674eb469f921dcdb12c68e817)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:21.994960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:21.997213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 112/231] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:21 2022] GET /identity/v3/users/8ff7898674eb469f921dcdb12c68e817 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:22.003243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:22.026221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 120/232] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:21 2022] PUT /identity/v3/projects/5565ecc493584acf98865b488c38a86e/users/8ff7898674eb469f921dcdb12c68e817/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:22.157733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1bc25-1632-4ace-9f4a-9235aa08c2d4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:22.205181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:22.215347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6c789-c00c-4461-946b-bfb723a637e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:22.216367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c789-c00c-4461-946b-bfb723a637e7 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:22.216896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c789-c00c-4461-946b-bfb723a637e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:22.217401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c789-c00c-4461-946b-bfb723a637e7 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:22.218836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6c789-c00c-4461-946b-bfb723a637e7 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:22.228845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6c789-c00c-4461-946b-bfb723a637e7 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:22.228845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 113/233] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:22 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:22.229019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:22.301607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:22.349742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387916d-525f-40aa-bd40-68b895b469a3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:22.389456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607f99-cd4d-40bb-a545-89c6c41ee44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:22.390516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607f99-cd4d-40bb-a545-89c6c41ee44f None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:22.390999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607f99-cd4d-40bb-a545-89c6c41ee44f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:22.391489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607f99-cd4d-40bb-a545-89c6c41ee44f None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e/users/8ff7898674eb469f921dcdb12c68e817/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:22.394165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607f99-cd4d-40bb-a545-89c6c41ee44f None admin] RBAC: Authorizing `identity:create_grant(project_id=5565ecc493584acf98865b488c38a86e, user_id=8ff7898674eb469f921dcdb12c68e817, role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:22.395932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607f99-cd4d-40bb-a545-89c6c41ee44f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:22.597052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 121/234] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:22 2022] PUT /identity/v3/projects/5565ecc493584acf98865b488c38a86e/users/8ff7898674eb469f921dcdb12c68e817/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:22.600606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423387-02d5-4d63-b22b-2619b5d6d920 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:22.601162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423387-02d5-4d63-b22b-2619b5d6d920 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:22.601639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423387-02d5-4d63-b22b-2619b5d6d920 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:22.603478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 114/235] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:22.609292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c1ce-e155-41cd-a539-a8e298aeb169 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:22.609936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c1ce-e155-41cd-a539-a8e298aeb169 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:22.610424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c1ce-e155-41cd-a539-a8e298aeb169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:22.638565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b938c1ce-e155-41cd-a539-a8e298aeb169 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:22.640245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b938c1ce-e155-41cd-a539-a8e298aeb169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:22.705013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb9c2-7d50-49f4-8061-817834b662c2 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:22.705438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb9c2-7d50-49f4-8061-817834b662c2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:22.705607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb9c2-7d50-49f4-8061-817834b662c2 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:22.707656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 115/236] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:22.723790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6785-c00b-4c43-a8ab-7c6ddae973a4 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:22.723790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6785-c00b-4c43-a8ab-7c6ddae973a4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:22.724039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6785-c00b-4c43-a8ab-7c6ddae973a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:22.732905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 122/237] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:22.757729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-235c6785-c00b-4c43-a8ab-7c6ddae973a4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:22.759321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-235c6785-c00b-4c43-a8ab-7c6ddae973a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:22.866639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 116/238] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:22.996586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac45a5-8d5a-4b85-be90-3de6e7429ab9 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:22.997246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac45a5-8d5a-4b85-be90-3de6e7429ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:22.997707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac45a5-8d5a-4b85-be90-3de6e7429ab9 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:22.999239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 123/239] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:23.004934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7bac1-b5b5-4aa1-a10c-264118357298 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:23.005248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7bac1-b5b5-4aa1-a10c-264118357298 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:23.005523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7bac1-b5b5-4aa1-a10c-264118357298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:23.025754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d4e7bac1-b5b5-4aa1-a10c-264118357298 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:23.027291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d4e7bac1-b5b5-4aa1-a10c-264118357298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:23.102900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 117/240] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:23.169754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac45a5-8d5a-4b85-be90-3de6e7429ab9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:23.235018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7bac1-b5b5-4aa1-a10c-264118357298 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:23.246404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:23.319774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac45a5-8d5a-4b85-be90-3de6e7429ab9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:23.335463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:23.363124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:23.364190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:23.364724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:23.365221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:23.377203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:23.382906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:23.383847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:23.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:23.387312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7bac1-b5b5-4aa1-a10c-264118357298 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:23.387536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 124/241] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:23.393517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:23.441569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:23.442233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:23.442509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:23.442775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:23.444062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:23.445658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:23.447512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 118/242] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:23.452986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:23.511717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6a19-0f49-436e-a61a-4eea934bf89e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:23.531373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:23.553048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:23.553869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:23.554255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:23.554632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:23.555468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:23.555858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:23.557396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:23.567874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 125/243] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:23.568679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:23.615322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75996-504c-4cb8-904b-94e1909148ad None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:23.644340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:23.657206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:23.659698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:23.659698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:23.659698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:23.659698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:23.661590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:23.700313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a68c-b945-4af4-87c7-5459a649da20 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:23.736975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:23.737688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:23.737990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:23.738287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:23.749011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:23.754712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:23.756012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:23.756783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 126/244] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:23.758060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:23.793214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 119/245] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:23 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:23.794193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:23.805579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:23.987145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fb32-4aab-4f2b-b36b-92fc01517cfd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:24.023649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4c87d-21d0-413a-aea6-1757a7cc446e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:24.041056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:24.041743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.042024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.042359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] PATH_INFO: `/v3/users/14ad2a5b5ee4483b89f83be9d6a8715e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.058531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] RBAC: Authorizing `identity:get_user(user_id=14ad2a5b5ee4483b89f83be9d6a8715e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:24.060180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:24.062981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 127/246] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:23 2022] GET /identity/v3/users/14ad2a5b5ee4483b89f83be9d6a8715e => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:24.072175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:24.073710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:24.074692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.075482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.075908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.077737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:24.078197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:24.079862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:24.091323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 120/247] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:24.097926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:24.174421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:24.224176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:24.237888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22454116-917a-4bf5-8084-337c94bc5e4d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:24.272110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497aca8-3800-4f7d-9ea3-36eb12236b2b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:24.287444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f9aa5-b04e-45d4-b80d-d2457ce40cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:24.289162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f9aa5-b04e-45d4-b80d-d2457ce40cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.289615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f9aa5-b04e-45d4-b80d-d2457ce40cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.290379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f9aa5-b04e-45d4-b80d-d2457ce40cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.331472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:24.333697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.334361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.334802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] PATH_INFO: `/v3/users/4f52d0b050594c20b467282879a6a40a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.336403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] RBAC: Authorizing `identity:get_user(user_id=4f52d0b050594c20b467282879a6a40a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:24.338807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:24.340715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 121/248] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:24 2022] GET /identity/v3/users/4f52d0b050594c20b467282879a6a40a => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:24.348084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:24.391742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f9aa5-b04e-45d4-b80d-d2457ce40cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:24.393708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f9aa5-b04e-45d4-b80d-d2457ce40cf3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:24.493120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2fbf-e243-4e42-bdf7-0d0c7edf5c40 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:24.512353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:24.520362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:24.533752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 128/249] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:24.538319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d0e6-6d98-4766-9815-485bb3b955b3 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.538608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d0e6-6d98-4766-9815-485bb3b955b3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.544734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d0e6-6d98-4766-9815-485bb3b955b3 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.544975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2eae0-cb3b-46ca-ab83-091f70aec0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:24.544975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2eae0-cb3b-46ca-ab83-091f70aec0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.545285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 129/250] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:24.545359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2eae0-cb3b-46ca-ab83-091f70aec0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.545359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2eae0-cb3b-46ca-ab83-091f70aec0e7 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.545359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2eae0-cb3b-46ca-ab83-091f70aec0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:24.545528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d0e6-6d98-4766-9815-485bb3b955b3 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:24.545607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2eae0-cb3b-46ca-ab83-091f70aec0e7 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:24.547141 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 122/251] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:24 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:24.551631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e4c5-8970-429a-bbf2-744791a2f8ac None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.552149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e4c5-8970-429a-bbf2-744791a2f8ac None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.552646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e4c5-8970-429a-bbf2-744791a2f8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.577967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-75d6e4c5-8970-429a-bbf2-744791a2f8ac None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:24.579654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-75d6e4c5-8970-429a-bbf2-744791a2f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:24.662342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 123/252] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:24.663567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e4c5-8970-429a-bbf2-744791a2f8ac None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:24.678573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d0e6-6d98-4766-9815-485bb3b955b3 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:24.723963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:24.724992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.725522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.726037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.727455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:24.729231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:24.731690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 130/253] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:24 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:24.738896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:24.853432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e4c5-8970-429a-bbf2-744791a2f8ac None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:24.853432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:24.864061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:24.891163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8204a-23f8-4375-a323-09bcb972d48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:24.891893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8204a-23f8-4375-a323-09bcb972d48b None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:24.892182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8204a-23f8-4375-a323-09bcb972d48b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:24.892453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8204a-23f8-4375-a323-09bcb972d48b None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e/users/4f52d0b050594c20b467282879a6a40a/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:24.899529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8204a-23f8-4375-a323-09bcb972d48b None admin] RBAC: Authorizing `identity:create_grant(project_id=5565ecc493584acf98865b488c38a86e, user_id=4f52d0b050594c20b467282879a6a40a, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:24.899529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8204a-23f8-4375-a323-09bcb972d48b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:24.958611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65633f1-8bb2-4675-aaec-b8644d268720 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:25.013827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:25.014849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:25.015328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:25.015796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:25.016736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] RBAC: Adding query filter params (role.id=9322053026b1462eab80ec804372705b, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=14ad2a5b5ee4483b89f83be9d6a8715e) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:25.017459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:25.019267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:25.026251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 131/254] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:24 2022] GET /identity/v3/role_assignments?user.id=14ad2a5b5ee4483b89f83be9d6a8715e&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=9322053026b1462eab80ec804372705b => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:25.027459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:25.086576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 124/255] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:24 2022] PUT /identity/v3/projects/5565ecc493584acf98865b488c38a86e/users/4f52d0b050594c20b467282879a6a40a/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:25.180898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eaa83-d278-48bf-8aea-dbea324b0825 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:25.225409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:25.231455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dff97-9435-4012-981d-0ffcf44a63b4 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:25.231756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dff97-9435-4012-981d-0ffcf44a63b4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:25.232014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dff97-9435-4012-981d-0ffcf44a63b4 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:25.233426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 125/256] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:25.245570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:25.246697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:25.247186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:25.247688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:25.250907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55b9a-151e-40bc-b33f-3a529e41f7cb None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:25.251200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55b9a-151e-40bc-b33f-3a529e41f7cb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:25.251499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55b9a-151e-40bc-b33f-3a529e41f7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:25.261953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:25.268956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:25.270625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:25.271375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:25.273872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 132/257] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:25.283146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:25.287969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-25d55b9a-151e-40bc-b33f-3a529e41f7cb None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:25.289243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-25d55b9a-151e-40bc-b33f-3a529e41f7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:25.434621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee4e6-ceb9-4df8-8d22-1998b622300d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:25.436988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 126/258] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:25.471971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:25.473186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:25.473470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:25.473740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:25.474413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:25.474722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:25.476108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:25.485780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 133/259] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:25.491721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55b9a-151e-40bc-b33f-3a529e41f7cb None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:25.626827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:25.631275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55b9a-151e-40bc-b33f-3a529e41f7cb None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:25.677548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:25.678520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:25.678881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:25.679157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] PATH_INFO: `/v3/users/8ff7898674eb469f921dcdb12c68e817` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:25.680704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff7898674eb469f921dcdb12c68e817)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:25.683484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:25.685331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 127/260] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:25 2022] GET /identity/v3/users/8ff7898674eb469f921dcdb12c68e817 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:25.691815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:25.759559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:25.838382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbd5b9-ef98-4b3d-891d-ee81a91114b6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:25.876743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:25.900321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:25.901397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:25.901870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:25.902348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:25.993223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:25.994725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:26.043272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:26.057512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec1764-1a78-44ee-bc48-2731d1e66904 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:26.105681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 134/261] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:26.118656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:26.131207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:26.131875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:26.132159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:26.132427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:26.147251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:26.153194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:26.154173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:26.154946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 128/262] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:26.165196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:26.237470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:26.318180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8109f-601f-444d-a981-d8fbdd53f983 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:26.326279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34945086-5ca8-40b0-977c-4007c0ef1769 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:26.358224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:26.358852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:26.360352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:26.360352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:26.360809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:26.361194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:26.362590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:26.372253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 129/263] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:26.378342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:26.393536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225049-9785-489a-b709-97b26634f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:26.394633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225049-9785-489a-b709-97b26634f679 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:26.395141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225049-9785-489a-b709-97b26634f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:26.395631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225049-9785-489a-b709-97b26634f679 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:26.397483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225049-9785-489a-b709-97b26634f679 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:26.400180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225049-9785-489a-b709-97b26634f679 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:26.411355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 135/264] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:26 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:26.430189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225049-9785-489a-b709-97b26634f679 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:26.461728 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:26.500498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ed02-07fb-47a1-9eb2-4091390d28f4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:26.504309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:26.539715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:26.540468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:26.540754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:26.541032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] PATH_INFO: `/v3/users/8ff7898674eb469f921dcdb12c68e817` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:26.542346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff7898674eb469f921dcdb12c68e817)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:26.543902 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:26.549304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 130/265] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:26 2022] GET /identity/v3/users/8ff7898674eb469f921dcdb12c68e817 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:26.552255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:26.605945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225049-9785-489a-b709-97b26634f679 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:26.666513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:26.667132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:26.667412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:26.667683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:26.668421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=8ff7898674eb469f921dcdb12c68e817) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:26.668729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:26.670220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:26.682258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 136/266] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:26 2022] GET /identity/v3/role_assignments?user.id=8ff7898674eb469f921dcdb12c68e817&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:26.708183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa72c-9be8-4f34-8ca7-ec96c3642470 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:26.794054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:26.795016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:26.795461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:26.795955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:26.867833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:26.980594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:26.982428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:27.103097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 131/267] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:08:27.106524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:27.231256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:27.260236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cedf9-624e-4842-9c2c-b92627e8140f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:27.307133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713786-fe68-43ab-835f-fa83fabe03f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:27.307786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713786-fe68-43ab-835f-fa83fabe03f5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.308065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713786-fe68-43ab-835f-fa83fabe03f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.308336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713786-fe68-43ab-835f-fa83fabe03f5 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:27.309555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713786-fe68-43ab-835f-fa83fabe03f5 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:27.311024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713786-fe68-43ab-835f-fa83fabe03f5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:27.312984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 137/268] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:27 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:27.320632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:27.416947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:27.482666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63c45-c687-4f9d-a143-5702814ab5b4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:27.513181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb9cd-ab55-4988-b5b4-a2af2ac59059 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.514155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb9cd-ab55-4988-b5b4-a2af2ac59059 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.514640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb9cd-ab55-4988-b5b4-a2af2ac59059 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:27.516485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 138/269] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:27.522035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55a45-0d92-4c9a-9852-e44604c0cb84 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.522589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55a45-0d92-4c9a-9852-e44604c0cb84 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.523073 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55a45-0d92-4c9a-9852-e44604c0cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:27.542417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6a777-4bec-4b65-99ec-4b8a34c0af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:27.543041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a777-4bec-4b65-99ec-4b8a34c0af75 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.543320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a777-4bec-4b65-99ec-4b8a34c0af75 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.543589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a777-4bec-4b65-99ec-4b8a34c0af75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:27.544160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-44c55a45-0d92-4c9a-9852-e44604c0cb84 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:27.544338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6a777-4bec-4b65-99ec-4b8a34c0af75 None admin] RBAC: Adding query filter params (role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=8ff7898674eb469f921dcdb12c68e817) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:27.544622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6a777-4bec-4b65-99ec-4b8a34c0af75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:27.545980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-44c55a45-0d92-4c9a-9852-e44604c0cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:27.546106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6a777-4bec-4b65-99ec-4b8a34c0af75 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:27.558257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 132/270] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:27 2022] GET /identity/v3/role_assignments?user.id=8ff7898674eb469f921dcdb12c68e817&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:27.648880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7535-6fea-4d66-a2be-fe349fd00ea9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.649323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7535-6fea-4d66-a2be-fe349fd00ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.649663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7535-6fea-4d66-a2be-fe349fd00ea9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:27.651435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 133/271] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:27.660978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d969bc2-8004-404d-9c34-7abb7e26a587 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.660978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d969bc2-8004-404d-9c34-7abb7e26a587 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.660978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d969bc2-8004-404d-9c34-7abb7e26a587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:27.676131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 139/272] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:27.690243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-6d969bc2-8004-404d-9c34-7abb7e26a587 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:27.691783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6d969bc2-8004-404d-9c34-7abb7e26a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:27.803769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 134/273] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:27.971797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c55a45-0d92-4c9a-9852-e44604c0cb84 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:27.984617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843de1b-773d-489e-827d-8f1d2e67d373 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.984911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843de1b-773d-489e-827d-8f1d2e67d373 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.985216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843de1b-773d-489e-827d-8f1d2e67d373 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:27.986579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 135/274] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:27.992866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cff80-7d96-4ad7-8efb-dbb7d5678089 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:27.993484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cff80-7d96-4ad7-8efb-dbb7d5678089 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:27.994018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cff80-7d96-4ad7-8efb-dbb7d5678089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.016273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-251cff80-7d96-4ad7-8efb-dbb7d5678089 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:28.017547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-251cff80-7d96-4ad7-8efb-dbb7d5678089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:28.080678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:28.094288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:28.119195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c55a45-0d92-4c9a-9852-e44604c0cb84 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:28.119872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 136/275] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:28.149245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cff80-7d96-4ad7-8efb-dbb7d5678089 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:28.161579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:28.162240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.162518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.162793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.164511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:28.166203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:28.168621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 140/276] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:28.174412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:28.288401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cff80-7d96-4ad7-8efb-dbb7d5678089 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:28.292529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da280a-36b4-4517-930f-6f24c7e6739c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:28.331275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75059a4-a7b2-4c75-ae25-e15e50b0cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:28.331831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75059a4-a7b2-4c75-ae25-e15e50b0cf90 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.332108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75059a4-a7b2-4c75-ae25-e15e50b0cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.332372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75059a4-a7b2-4c75-ae25-e15e50b0cf90 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.333143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5c00b-20f0-4914-ab2b-66424e57f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:28.334176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75059a4-a7b2-4c75-ae25-e15e50b0cf90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:28.334270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c00b-20f0-4914-ab2b-66424e57f60c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.334270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c00b-20f0-4914-ab2b-66424e57f60c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.334398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c00b-20f0-4914-ab2b-66424e57f60c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.334920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75059a4-a7b2-4c75-ae25-e15e50b0cf90 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:28.349257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5c00b-20f0-4914-ab2b-66424e57f60c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-72a5c00b-20f0-4914-ab2b-66424e57f60c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:28.354204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:28.360297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 137/277] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:08:28.361600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317f90-1589-4f68-ac48-3e579130e791 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.362355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317f90-1589-4f68-ac48-3e579130e791 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.362355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317f90-1589-4f68-ac48-3e579130e791 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.362355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 138/278] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:28.362355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be317f90-1589-4f68-ac48-3e579130e791 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:28.409004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:28.469549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be317f90-1589-4f68-ac48-3e579130e791 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:28.486991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:28.492870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 141/279] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:28 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:28.496879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2d82a-771a-4d87-a7ce-931fb0c44048 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.496879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2d82a-771a-4d87-a7ce-931fb0c44048 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.496879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2d82a-771a-4d87-a7ce-931fb0c44048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.514879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:28.514879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.515254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.515479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.516192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] RBAC: Adding query filter params (name=member) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:28.516520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:28.518050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:28.527316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-09f2d82a-771a-4d87-a7ce-931fb0c44048 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:28.528652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-09f2d82a-771a-4d87-a7ce-931fb0c44048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:28.534639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 139/280] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:28.534639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:28.609245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 142/281] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:28.610493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2d82a-771a-4d87-a7ce-931fb0c44048 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:28.687495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d70b-14df-4758-9d8d-9c15a5238626 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:28.689344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:28.730905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:28.731689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.732018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.732363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.744978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:28.750026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:28.750931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:28.752337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 140/282] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:28.760146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:28.764103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2d82a-771a-4d87-a7ce-931fb0c44048 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:28.802171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:28.817786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:28.818441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.818719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.818987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] PATH_INFO: `/v3/users/abd1eb8f62234ddfb24334d9e0bdc9e3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.837932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] RBAC: Authorizing `identity:get_user(user_id=abd1eb8f62234ddfb24334d9e0bdc9e3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:28.839473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:28.841474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 143/283] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:28 2022] GET /identity/v3/users/abd1eb8f62234ddfb24334d9e0bdc9e3 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:28.852581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:28.905040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2583a20-bb8a-42a6-99c6-f6310f6b8753 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:28.958380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:28.959146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:28.959428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:28.959706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:28.960535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] RBAC: Adding query filter params (name=member) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:28.960843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:28.962895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:28.974868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 141/284] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:28.975785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:29.008644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed4477-29df-43ec-a110-e103c97ea29a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:29.011326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:29.061814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:29.062588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:29.062906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:29.064134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:29.064942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, user.id=abd1eb8f62234ddfb24334d9e0bdc9e3, scope.system=all) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:29.065289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:29.067263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:29.075124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 144/285] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 21:08:28 2022] GET /identity/v3/role_assignments?user.id=abd1eb8f62234ddfb24334d9e0bdc9e3&scope.system=all&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:29.076024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:29.147392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd454-2c26-4b8f-aba1-3aa2f869889e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:29.158665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:29.228157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33867c-c31b-49cc-b544-1f94973510ef None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:29.267441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:29.268180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:29.268759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:29.269163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:29.275824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:29.276719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:29.277395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:29.278672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] PATH_INFO: `/v3/users/4f52d0b050594c20b467282879a6a40a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:29.280996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] RBAC: Authorizing `identity:get_user(user_id=4f52d0b050594c20b467282879a6a40a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:29.283216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:29.285825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:29.286009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 145/286] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:29 2022] GET /identity/v3/users/4f52d0b050594c20b467282879a6a40a => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:29.291843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:29.293995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:29.295078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:29.295934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:29.298681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 142/287] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:29.305777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:29.448548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ec95-f749-46c0-b8cc-852366c8c96a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:29.470881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:29.481392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:29.500255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472467d-d66b-4ed5-92ec-853b4c0d6c70 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:29.521950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:29.522820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:29.523104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:29.523376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:29.561138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:29.561799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:29.562085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:29.562362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:29.563045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:29.563353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:29.564803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:29.601774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 143/288] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:29.611038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:29.620202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:29.621749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:29.735450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 146/289] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:08:29.741208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:29.761948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:29.855851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506136b-4971-407c-91af-3fbf68880d0c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:29.905863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:29.906527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:29.906814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:29.907091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:29.908357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:29.908919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02dbff-31f5-4a60-9b8a-f54f31bce4e1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:29.909953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:29.911678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 147/290] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:29 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:29.919038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:29.983664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:29.984711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:29.987080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:29.987560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] PATH_INFO: `/v3/users/14ad2a5b5ee4483b89f83be9d6a8715e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:29.989637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] RBAC: Authorizing `identity:get_user(user_id=14ad2a5b5ee4483b89f83be9d6a8715e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:29.992000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:29.995191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 144/291] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:29 2022] GET /identity/v3/users/14ad2a5b5ee4483b89f83be9d6a8715e => generated 297 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:30.004158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:30.029501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:30.096818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:30.124375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080f1e-9eb4-4fed-bb2b-21f73bf8d348 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:30.154706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5a3a9-d9cd-491b-853c-60b8228391fb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:30.180671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:30.182519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:30.182857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:30.183194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:30.183976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=4f52d0b050594c20b467282879a6a40a) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:30.184289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:30.185834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:30.194915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 148/292] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:29 2022] GET /identity/v3/role_assignments?user.id=4f52d0b050594c20b467282879a6a40a&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:30.217097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0913b-839e-4339-9b38-e86eac5f61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:30.217765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0913b-839e-4339-9b38-e86eac5f61e4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:30.218110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0913b-839e-4339-9b38-e86eac5f61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:30.218383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0913b-839e-4339-9b38-e86eac5f61e4 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:30.219705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0913b-839e-4339-9b38-e86eac5f61e4 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:30.221270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0913b-839e-4339-9b38-e86eac5f61e4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:30.226455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 145/293] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:29 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:30.232978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:30.392841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40c17d-21fc-4634-b7e8-671d0eda3b25 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:30.447222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a360b46-1f2a-47c2-bf24-6ea20eea5909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:30.447937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360b46-1f2a-47c2-bf24-6ea20eea5909 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:30.448215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360b46-1f2a-47c2-bf24-6ea20eea5909 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:30.448526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360b46-1f2a-47c2-bf24-6ea20eea5909 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e/users/14ad2a5b5ee4483b89f83be9d6a8715e/roles/9322053026b1462eab80ec804372705b` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:30.450733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a360b46-1f2a-47c2-bf24-6ea20eea5909 None admin] RBAC: Authorizing `identity:create_grant(project_id=5565ecc493584acf98865b488c38a86e, user_id=14ad2a5b5ee4483b89f83be9d6a8715e, role_id=9322053026b1462eab80ec804372705b)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:30.452969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a360b46-1f2a-47c2-bf24-6ea20eea5909 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:30.551460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 149/294] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:08:30 2022] PUT /identity/v3/projects/5565ecc493584acf98865b488c38a86e/users/14ad2a5b5ee4483b89f83be9d6a8715e/roles/9322053026b1462eab80ec804372705b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:30.892245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b03939-5351-401e-aa55-ec53a1065fdb None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:30.892757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b03939-5351-401e-aa55-ec53a1065fdb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:30.893006 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b03939-5351-401e-aa55-ec53a1065fdb None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:30.895188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 146/295] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:30.901841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866b4e7-bc4d-4468-81bb-107c1fb5a403 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:30.902352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866b4e7-bc4d-4468-81bb-107c1fb5a403 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:30.902424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866b4e7-bc4d-4468-81bb-107c1fb5a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:30.935030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a866b4e7-bc4d-4468-81bb-107c1fb5a403 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:30.936865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a866b4e7-bc4d-4468-81bb-107c1fb5a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:30.940752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:31.026608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 150/296] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:31.275538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e9eca-aa60-4ddc-b466-d8b8a81a13eb None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:31.276222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e9eca-aa60-4ddc-b466-d8b8a81a13eb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:31.276715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e9eca-aa60-4ddc-b466-d8b8a81a13eb None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:31.278688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 147/297] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:31.285264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13be7-9d30-4fb3-be9a-1cce26a27019 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:31.285839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13be7-9d30-4fb3-be9a-1cce26a27019 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:31.286330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13be7-9d30-4fb3-be9a-1cce26a27019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:31.307713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0bb13be7-9d30-4fb3-be9a-1cce26a27019 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:31.309333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0bb13be7-9d30-4fb3-be9a-1cce26a27019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:31.321790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e9eca-aa60-4ddc-b466-d8b8a81a13eb None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:31.413837 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 151/298] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:31.447261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:31.469417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e9eca-aa60-4ddc-b466-d8b8a81a13eb None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:31.486338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea0df5-c5b8-48e2-b094-f05a87180e5d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:31.487023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea0df5-c5b8-48e2-b094-f05a87180e5d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:31.487527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea0df5-c5b8-48e2-b094-f05a87180e5d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:31.489137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 152/299] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:08:31.494827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37aa8-1a19-4532-a21e-94aa672701a1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:31.495289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37aa8-1a19-4532-a21e-94aa672701a1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:31.495630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37aa8-1a19-4532-a21e-94aa672701a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:31.513965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:31.514897 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:31.515403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:31.515876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:31.518497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-07f37aa8-1a19-4532-a21e-94aa672701a1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:31.521210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-07f37aa8-1a19-4532-a21e-94aa672701a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:31.529987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:31.536869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:31.537846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:31.538672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:31.546709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 148/300] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:31.548723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:31.608813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:31.614995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 153/301] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:31.679771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133cf24-ae5f-4011-ba4d-956ea504ff40 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:31.713264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37aa8-1a19-4532-a21e-94aa672701a1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:31.739024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:31.739644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:31.739928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:31.740200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:31.740904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:31.741358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:31.742696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:31.753176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 149/302] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:31.760160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:31.764341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:31.895251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37aa8-1a19-4532-a21e-94aa672701a1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:31.943837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425bbeb-1cb1-413b-93c0-99a8ce4b28c1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:31.954372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:31.955802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:31.956474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:31.956949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:31.958620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:31.960546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:31.963726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 154/303] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:31.970889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:32.005304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:32.006019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.006399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.007665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] PATH_INFO: `/v3/users/ef933176ce5547deade798835709707e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.031966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] RBAC: Authorizing `identity:get_user(user_id=ef933176ce5547deade798835709707e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:32.034102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:32.037762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 150/304] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:31 2022] GET /identity/v3/users/ef933176ce5547deade798835709707e => generated 293 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:32.038096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:32.083559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:32.128163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:32.140116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2711734-23c2-49cd-874d-3cb7dfb90a5c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:32.184625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe9b2-866b-4a0d-856f-e5e7e73a4f5c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:32.190574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:32.191880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.192380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.192874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] PATH_INFO: `/v3/groups` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.193807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:32.196946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:32.241005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68829814-9347-405c-9998-47e6060e7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:32.241881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829814-9347-405c-9998-47e6060e7aec None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.242004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829814-9347-405c-9998-47e6060e7aec None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.242226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829814-9347-405c-9998-47e6060e7aec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.253667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68829814-9347-405c-9998-47e6060e7aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-68829814-9347-405c-9998-47e6060e7aec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:32.258843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:32.260509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 151/305] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:32.262160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68829814-9347-405c-9998-47e6060e7aec None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:32.307904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 155/306] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Aug 29 21:08:31 2022] POST /identity/v3/groups => generated 229 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:32.314418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:32.406132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68829814-9347-405c-9998-47e6060e7aec None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:32.441844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:32.465674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7971b-2d2f-4306-b5f6-1098b11269fd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:32.466635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:32.467973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.468711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.470111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.471839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] RBAC: Adding query filter params (role.id=9322053026b1462eab80ec804372705b, user.id=ef933176ce5547deade798835709707e, scope.system=all) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:32.473320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:32.476374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:32.486383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 152/307] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 21:08:32 2022] GET /identity/v3/role_assignments?user.id=ef933176ce5547deade798835709707e&scope.system=all&role.id=9322053026b1462eab80ec804372705b => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:32.513467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:32.530596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:32.531698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.532162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.532621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.533956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:32.534504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:32.537982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:32.553724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 156/308] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:32.565117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:32.701500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3464-066e-415b-a2ee-2bc98190d453 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:32.741192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1db0-9f86-4fd9-b25e-8fb3d8e42f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:32.741845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1db0-9f86-4fd9-b25e-8fb3d8e42f05 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.742124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1db0-9f86-4fd9-b25e-8fb3d8e42f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.742617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1db0-9f86-4fd9-b25e-8fb3d8e42f05 None admin] PATH_INFO: `/v3/users/abd1eb8f62234ddfb24334d9e0bdc9e3` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.743873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1db0-9f86-4fd9-b25e-8fb3d8e42f05 None admin] RBAC: Authorizing `identity:get_user(user_id=abd1eb8f62234ddfb24334d9e0bdc9e3)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:32.745444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1db0-9f86-4fd9-b25e-8fb3d8e42f05 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:32.747381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 153/309] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:32 2022] GET /identity/v3/users/abd1eb8f62234ddfb24334d9e0bdc9e3 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:32.754206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:32.796974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2f3b7-86c4-4c41-856f-193355fef926 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.797341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2f3b7-86c4-4c41-856f-193355fef926 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.797581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2f3b7-86c4-4c41-856f-193355fef926 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.799245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 154/310] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:32.804918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651471-43ea-4b84-9321-5e8411e8a87d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.805254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651471-43ea-4b84-9321-5e8411e8a87d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.805524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651471-43ea-4b84-9321-5e8411e8a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.830645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-23651471-43ea-4b84-9321-5e8411e8a87d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:32.832389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-23651471-43ea-4b84-9321-5e8411e8a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:32.893050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247f54-7ad2-41ce-ac54-200d9aeaa75f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:32.929453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:32.930132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 155/311] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:32.950765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:32.951442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:32.951776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:32.952000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] PATH_INFO: `/v3/system/users/abd1eb8f62234ddfb24334d9e0bdc9e3/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:32.953552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=abd1eb8f62234ddfb24334d9e0bdc9e3, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:32.955007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:33.087829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 157/312] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Aug 29 21:08:32 2022] PUT /identity/v3/system/users/abd1eb8f62234ddfb24334d9e0bdc9e3/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:33.221697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651471-43ea-4b84-9321-5e8411e8a87d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:33.347687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651471-43ea-4b84-9321-5e8411e8a87d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:33.389398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:33.390045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:33.390371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:33.390645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:33.403170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:33.408157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:33.409033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:33.409883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 156/313] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:33.418361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:33.482114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:33.530919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ba36e-54c8-4d33-9862-2b241454b3ba None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:33.572802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:33.573456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:33.573734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:33.573996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:33.574674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:33.574984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:33.576369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:33.586169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 158/314] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:33.591826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:33.644682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:33.708515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfac68-fdb4-408c-9004-4f971fd5a711 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:33.748981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:33.749573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:33.749901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:33.750179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] PATH_INFO: `/v3/users/14ad2a5b5ee4483b89f83be9d6a8715e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:33.751517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] RBAC: Authorizing `identity:get_user(user_id=14ad2a5b5ee4483b89f83be9d6a8715e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:33.753071 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:33.755869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 157/315] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:33 2022] GET /identity/v3/users/14ad2a5b5ee4483b89f83be9d6a8715e => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:33.761569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:33.884398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6434-5f7e-4294-8185-2e261a6f4f5e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:33.902393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:33.921522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:33.922149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:33.922522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:33.922793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:33.999879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:34.001305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:34.115255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 159/316] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:08:34.121322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:34.251245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c201-e23f-4a43-8f42-8479f600f2fa None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:34.267187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:34.291888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a0a35-5b41-44e8-ad8c-c00aed6e3cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:34.292564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a0a35-5b41-44e8-ad8c-c00aed6e3cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:34.292846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a0a35-5b41-44e8-ad8c-c00aed6e3cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:34.293163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a0a35-5b41-44e8-ad8c-c00aed6e3cb8 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:34.294643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a0a35-5b41-44e8-ad8c-c00aed6e3cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:34.296169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a0a35-5b41-44e8-ad8c-c00aed6e3cb8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:34.298431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 158/317] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:34 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:34.304563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:34.333471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:34.416036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42ae2-0fda-408c-b4dd-d6340f1362c2 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:34.454562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e59b-23f5-4767-9e6e-73087254f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:34.455244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e59b-23f5-4767-9e6e-73087254f7dc None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:34.455588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e59b-23f5-4767-9e6e-73087254f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:34.455839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e59b-23f5-4767-9e6e-73087254f7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:34.457152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e59b-23f5-4767-9e6e-73087254f7dc None admin] RBAC: Adding query filter params (role.id=9322053026b1462eab80ec804372705b, scope.project.id=5565ecc493584acf98865b488c38a86e, user.id=14ad2a5b5ee4483b89f83be9d6a8715e) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:34.457520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e59b-23f5-4767-9e6e-73087254f7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:34.459389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e59b-23f5-4767-9e6e-73087254f7dc None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:34.466749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 160/318] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:08:34 2022] GET /identity/v3/role_assignments?user.id=14ad2a5b5ee4483b89f83be9d6a8715e&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=9322053026b1462eab80ec804372705b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:34.636641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88182ee1-76c0-4b9f-882f-51e5aa32c54e None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:34.637305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88182ee1-76c0-4b9f-882f-51e5aa32c54e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:34.637793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88182ee1-76c0-4b9f-882f-51e5aa32c54e None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:34.639717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 159/319] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:34.646005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0c3b-5dd3-4d21-a08f-7816cd8dd8b5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:34.646492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0c3b-5dd3-4d21-a08f-7816cd8dd8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:34.646835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0c3b-5dd3-4d21-a08f-7816cd8dd8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:34.667742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c9ac0c3b-5dd3-4d21-a08f-7816cd8dd8b5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:34.668949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c9ac0c3b-5dd3-4d21-a08f-7816cd8dd8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:34.702067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f0b3d-22b7-4303-80de-3d5ccf2ac422 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:34.702067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f0b3d-22b7-4303-80de-3d5ccf2ac422 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:34.702776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f0b3d-22b7-4303-80de-3d5ccf2ac422 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:34.704022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 160/320] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:08:34.709507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26bb62-6880-42ed-bca7-f01e1bb57c7c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:34.709842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26bb62-6880-42ed-bca7-f01e1bb57c7c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:34.710117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26bb62-6880-42ed-bca7-f01e1bb57c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:34.730803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ca26bb62-6880-42ed-bca7-f01e1bb57c7c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:34.732173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ca26bb62-6880-42ed-bca7-f01e1bb57c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:34.762948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 161/321] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:34.815111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 161/322] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:35.041627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0c3b-5dd3-4d21-a08f-7816cd8dd8b5 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:35.055055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:35.085245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26bb62-6880-42ed-bca7-f01e1bb57c7c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:35.177924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0c3b-5dd3-4d21-a08f-7816cd8dd8b5 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:35.213862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26bb62-6880-42ed-bca7-f01e1bb57c7c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:35.218078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3ba04-0dba-4d62-aadd-a9acbee44d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:35.218715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ba04-0dba-4d62-aadd-a9acbee44d90 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.218991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ba04-0dba-4d62-aadd-a9acbee44d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.219262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ba04-0dba-4d62-aadd-a9acbee44d90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.228254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:35.230867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3ba04-0dba-4d62-aadd-a9acbee44d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-87a3ba04-0dba-4d62-aadd-a9acbee44d90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:35.235810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:35.242567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 162/323] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:35.243347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af9655-1af6-4af7-b807-dade829f9492 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.244030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af9655-1af6-4af7-b807-dade829f9492 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.244030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af9655-1af6-4af7-b807-dade829f9492 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.244030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 163/324] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:35.244030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af9655-1af6-4af7-b807-dade829f9492 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:35.259495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d0d5d-2954-45d3-9a61-2f21cf2816ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:35.260147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d0d5d-2954-45d3-9a61-2f21cf2816ad None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.260422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d0d5d-2954-45d3-9a61-2f21cf2816ad None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.260693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d0d5d-2954-45d3-9a61-2f21cf2816ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.261846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d0d5d-2954-45d3-9a61-2f21cf2816ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:35.263306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d0d5d-2954-45d3-9a61-2f21cf2816ad None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:35.264872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 162/325] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:35.269579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf77d2-cf90-4fa4-b95f-daa365cfdd5b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.269579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf77d2-cf90-4fa4-b95f-daa365cfdd5b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.269579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf77d2-cf90-4fa4-b95f-daa365cfdd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.285818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-56cf77d2-cf90-4fa4-b95f-daa365cfdd5b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:35.287126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-56cf77d2-cf90-4fa4-b95f-daa365cfdd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:35.322184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:35.355203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af9655-1af6-4af7-b807-dade829f9492 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:35.359242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 163/326] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:35.360127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf77d2-cf90-4fa4-b95f-daa365cfdd5b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:35.398624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:35.399153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.399352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.399619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.400291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:35.400592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:35.402015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:35.416600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 164/327] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:35.418146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:35.492123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf77d2-cf90-4fa4-b95f-daa365cfdd5b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:35.502813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:35.529816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:35.530498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.530816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.531092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] PATH_INFO: `/v3/groups` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.531728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:35.533246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:35.541962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10bcf-9cfa-43de-b8a5-51464e28d766 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:35.575753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:35.580819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:35.582153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.582410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.582683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] PATH_INFO: `/v3/users/ef933176ce5547deade798835709707e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.583828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] RBAC: Authorizing `identity:get_user(user_id=ef933176ce5547deade798835709707e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:35.585312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:35.586898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 165/328] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:35 2022] GET /identity/v3/users/ef933176ce5547deade798835709707e => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:35.592584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:35.676445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 164/329] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Aug 29 21:08:35 2022] POST /identity/v3/groups => generated 226 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:35.694228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:35.699418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383808f-bf3f-4e22-9505-5db1318e2864 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:35.743235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:35.744410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.744767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.745170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] PATH_INFO: `/v3/system/users/ef933176ce5547deade798835709707e/roles/9322053026b1462eab80ec804372705b` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.746796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef933176ce5547deade798835709707e, role_id=9322053026b1462eab80ec804372705b)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:35.748304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:35.820312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afd130-b864-4c2e-85c0-352276a6bff7 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:35.843041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 166/330] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Aug 29 21:08:35 2022] PUT /identity/v3/system/users/ef933176ce5547deade798835709707e/roles/9322053026b1462eab80ec804372705b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:08:35.875507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:35.876188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:35.876471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:35.876747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:35.902299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:35.907864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:35.908949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:35.909821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 165/331] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:08:35.915541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:36.004939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:36.067881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cf96a-0098-49c4-b60d-e90721813858 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:36.115740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:36.116275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:36.116551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:36.116818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:36.117670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:36.118042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:36.119659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:36.132633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 167/332] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:36.138324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:36.179298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:36.297636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39490ee3-6842-48cb-8575-f99b10cb22bc None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:36.349117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3039688-5a52-4d02-9b0f-75f762e7bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:36.349768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039688-5a52-4d02-9b0f-75f762e7bb3f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:36.350042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039688-5a52-4d02-9b0f-75f762e7bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:36.350308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039688-5a52-4d02-9b0f-75f762e7bb3f None admin] PATH_INFO: `/v3/users/abd1eb8f62234ddfb24334d9e0bdc9e3` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:36.352040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3039688-5a52-4d02-9b0f-75f762e7bb3f None admin] RBAC: Authorizing `identity:get_user(user_id=abd1eb8f62234ddfb24334d9e0bdc9e3)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:36.353622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3039688-5a52-4d02-9b0f-75f762e7bb3f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:36.355582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 166/333] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:36 2022] GET /identity/v3/users/abd1eb8f62234ddfb24334d9e0bdc9e3 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:36.361960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:36.493589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a6438-2614-40fb-8c36-555bac4b60ed None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:36.526617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:36.542505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad7ce8-0343-4419-b4f5-6671f986f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:36.543278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7ce8-0343-4419-b4f5-6671f986f153 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:36.551174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7ce8-0343-4419-b4f5-6671f986f153 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:36.551174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7ce8-0343-4419-b4f5-6671f986f153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:36.551174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad7ce8-0343-4419-b4f5-6671f986f153 None admin] RBAC: Adding query filter params (role.id=63e30c687d4b49118bf8ec5f3341f560, user.id=abd1eb8f62234ddfb24334d9e0bdc9e3, scope.system=all) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:36.551174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad7ce8-0343-4419-b4f5-6671f986f153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:36.551174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad7ce8-0343-4419-b4f5-6671f986f153 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:36.568598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 168/334] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 21:08:36 2022] GET /identity/v3/role_assignments?user.id=abd1eb8f62234ddfb24334d9e0bdc9e3&scope.system=all&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:38.153460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2775-888d-4e0f-ad20-a900439e9545 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:38.154451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2775-888d-4e0f-ad20-a900439e9545 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:38.154952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2775-888d-4e0f-ad20-a900439e9545 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:38.156908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 167/335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:38.163139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43547-7d3d-420c-96ad-7f794633fcc3 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:38.164416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43547-7d3d-420c-96ad-7f794633fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:38.164962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43547-7d3d-420c-96ad-7f794633fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:38.192691 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-59a43547-7d3d-420c-96ad-7f794633fcc3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:38.195169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-59a43547-7d3d-420c-96ad-7f794633fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:38.299179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 169/336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:38.384166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4989a8-5822-442a-b4ce-afa3a37fb9a9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:38.384793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4989a8-5822-442a-b4ce-afa3a37fb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:38.385316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4989a8-5822-442a-b4ce-afa3a37fb9a9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:38.386859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 168/337] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:38.393639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce85ac-a8b8-4a7b-9111-a1ee5b87ae70 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:38.394713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce85ac-a8b8-4a7b-9111-a1ee5b87ae70 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:38.395186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce85ac-a8b8-4a7b-9111-a1ee5b87ae70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:38.418292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-19ce85ac-a8b8-4a7b-9111-a1ee5b87ae70 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:38.419777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-19ce85ac-a8b8-4a7b-9111-a1ee5b87ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:38.535724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 170/338] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:38.638860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa07f6-f82b-4b54-9d62-c6e60020102e None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:38.639517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa07f6-f82b-4b54-9d62-c6e60020102e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:38.640173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa07f6-f82b-4b54-9d62-c6e60020102e None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:38.643289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 169/339] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:38.649828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adbfac-61fc-40a8-ac67-197dd8bb8bc3 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:38.650685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adbfac-61fc-40a8-ac67-197dd8bb8bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:38.651424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adbfac-61fc-40a8-ac67-197dd8bb8bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:38.689901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f9adbfac-61fc-40a8-ac67-197dd8bb8bc3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:38.692636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f9adbfac-61fc-40a8-ac67-197dd8bb8bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:38.770361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:38.807820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 171/340] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:38.964606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa07f6-f82b-4b54-9d62-c6e60020102e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.090573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adbfac-61fc-40a8-ac67-197dd8bb8bc3 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.101428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:39.109370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa07f6-f82b-4b54-9d62-c6e60020102e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:39.171383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:39.172053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.172328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.172611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.190831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:39.196706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:39.197676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:08:39.198449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:39.202167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 170/341] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:39.209974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.361828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adbfac-61fc-40a8-ac67-197dd8bb8bc3 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:39.374585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603d56-7855-4ccb-a59e-57c8f0b4ae24 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:39.422069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:39.423195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.423815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.424119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.425689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:39.426104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:39.428014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:39.447591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:39.448253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.448536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.448809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.455569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 171/342] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:39.456266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.476830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:39.482399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:39.483332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:39.484589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 172/343] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:39.485783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.497586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:39.539993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:39.625473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b598bb-9591-4f40-ada1-790b24b7c352 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:39.659126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545c55a-48ae-473d-a826-43564471f141 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:39.685197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4e70d-e9e2-4a77-a232-d8847143263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:39.688371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e70d-e9e2-4a77-a232-d8847143263a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.689149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e70d-e9e2-4a77-a232-d8847143263a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.689761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e70d-e9e2-4a77-a232-d8847143263a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.708082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4e70d-e9e2-4a77-a232-d8847143263a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:39.710927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:39.711587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.711869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.712150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] PATH_INFO: `/v3/users/ef933176ce5547deade798835709707e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.713497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] RBAC: Authorizing `identity:get_user(user_id=ef933176ce5547deade798835709707e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:39.715276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-cac4e70d-e9e2-4a77-a232-d8847143263a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:39.715582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:39.716542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:39.717386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:39.718597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 173/344] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:08:39 2022] GET /identity/v3/users/ef933176ce5547deade798835709707e => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:39.718835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.724780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 172/345] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:39.727420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bb48-dabf-4ffa-a27d-836d416a72d4 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.729011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bb48-dabf-4ffa-a27d-836d416a72d4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.729539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bb48-dabf-4ffa-a27d-836d416a72d4 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.731845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 173/346] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:39.732964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9bb48-dabf-4ffa-a27d-836d416a72d4 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.850583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:39.891871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9bb48-dabf-4ffa-a27d-836d416a72d4 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:39.892053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad3adf-d9d6-456a-bdc6-231684a6af0c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:39.892053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:39.926115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a4f42-eb06-4fe1-a403-e56a00d8e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:39.926738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a4f42-eb06-4fe1-a403-e56a00d8e60b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.929348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a4f42-eb06-4fe1-a403-e56a00d8e60b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.929348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a4f42-eb06-4fe1-a403-e56a00d8e60b None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.929348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a4f42-eb06-4fe1-a403-e56a00d8e60b None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:39.929348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a4f42-eb06-4fe1-a403-e56a00d8e60b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:39.929787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a4f42-eb06-4fe1-a403-e56a00d8e60b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:39.931204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:39.932224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.933049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.933517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.934455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] RBAC: Adding query filter params (role.id=9322053026b1462eab80ec804372705b, user.id=ef933176ce5547deade798835709707e, scope.system=all) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:39.934977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:39.937300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:39.940117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 174/347] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:39.942445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d854b-7582-4055-8d52-0f9b4cd944b9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:39.945125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d854b-7582-4055-8d52-0f9b4cd944b9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:39.945707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d854b-7582-4055-8d52-0f9b4cd944b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:39.965216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 174/348] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 21:08:39 2022] GET /identity/v3/role_assignments?user.id=ef933176ce5547deade798835709707e&scope.system=all&role.id=9322053026b1462eab80ec804372705b => generated 510 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:39.967586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:39.978354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-295d854b-7582-4055-8d52-0f9b4cd944b9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:39.980200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-295d854b-7582-4055-8d52-0f9b4cd944b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:40.148911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 175/349] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:40.150397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d854b-7582-4055-8d52-0f9b4cd944b9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:40.219737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5028b-0583-46dd-9e47-f90c53f347dd None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:40.288706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:40.289662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:40.289942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:40.290217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:40.290903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:40.291208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:40.294645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:40.298291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:40.308605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 175/350] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:40.315281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:40.343993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:40.354576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d854b-7582-4055-8d52-0f9b4cd944b9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:40.413625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:40.414351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:40.414630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:40.414918 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:40.476454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df15b3-308e-49b0-9fd3-465fb63d9593 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:40.500738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:40.502595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:40.526380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826ddcc-ceaa-4244-9fd1-eb58b80e45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:40.527204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ddcc-ceaa-4244-9fd1-eb58b80e45a3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:40.527487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ddcc-ceaa-4244-9fd1-eb58b80e45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:40.527761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ddcc-ceaa-4244-9fd1-eb58b80e45a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:40.613440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:40.620464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 176/351] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:40.627027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:40.629154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:40.635432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826ddcc-ceaa-4244-9fd1-eb58b80e45a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:40.637229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826ddcc-ceaa-4244-9fd1-eb58b80e45a3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:40.795005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711df5f-5095-4d7f-a29f-3ee52edb52f3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:40.821602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 176/352] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:08:40.827084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb345-87c7-468d-bc82-4e83e7329d26 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:40.827084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb345-87c7-468d-bc82-4e83e7329d26 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:40.827084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb345-87c7-468d-bc82-4e83e7329d26 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:40.827084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 177/353] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:40.827084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb345-87c7-468d-bc82-4e83e7329d26 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:40.863287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28685d-b670-467d-b300-4249daad2cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:40.864498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28685d-b670-467d-b300-4249daad2cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:40.865032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28685d-b670-467d-b300-4249daad2cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:40.865528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28685d-b670-467d-b300-4249daad2cb7 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:40.867037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28685d-b670-467d-b300-4249daad2cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:40.871524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28685d-b670-467d-b300-4249daad2cb7 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:40.871524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 177/354] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:40 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:40.872397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39e71-1d34-4da6-98c2-f1f8d636e2ed None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:40.872823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39e71-1d34-4da6-98c2-f1f8d636e2ed None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:40.873419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39e71-1d34-4da6-98c2-f1f8d636e2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:40.902824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9ad39e71-1d34-4da6-98c2-f1f8d636e2ed None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:40.904158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9ad39e71-1d34-4da6-98c2-f1f8d636e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:40.980866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:40.991635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb345-87c7-468d-bc82-4e83e7329d26 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:40.996930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:41.012908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 178/355] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:41.021965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad39e71-1d34-4da6-98c2-f1f8d636e2ed None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:41.052244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.053700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.055146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.055854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.076172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:41.083497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:41.084441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:41.085288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:41.088277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 178/356] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:41.089660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:41.174483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad39e71-1d34-4da6-98c2-f1f8d636e2ed None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:41.228593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.229519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.229947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.230638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.232522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:41.234610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:41.237702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 179/357] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:41.239044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:41.240766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31fbc-af03-4e3d-8e36-f0efbd67ff9d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:41.298011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43dc5-8043-49f9-b1ad-7ec4be8ec3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.299044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43dc5-8043-49f9-b1ad-7ec4be8ec3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.299556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43dc5-8043-49f9-b1ad-7ec4be8ec3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.300158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43dc5-8043-49f9-b1ad-7ec4be8ec3d3 None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.311961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43dc5-8043-49f9-b1ad-7ec4be8ec3d3 None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:41.313821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43dc5-8043-49f9-b1ad-7ec4be8ec3d3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:41.317104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 179/358] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:41.318657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8998-3f03-4d2a-bb28-af83ef0001b5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.319158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8998-3f03-4d2a-bb28-af83ef0001b5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.319679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8998-3f03-4d2a-bb28-af83ef0001b5 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.321277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 180/359] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:41.322270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8998-3f03-4d2a-bb28-af83ef0001b5 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:41.332487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:41.360449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:41.398281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e083-5a70-47aa-b93a-13115ac06a40 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:41.451632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.452888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.452888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.452888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.454229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:41.454730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:41.456375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:41.470913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 180/360] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:41.472048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:41.494867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8998-3f03-4d2a-bb28-af83ef0001b5 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:41.551798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc653b-68fc-49a8-8ade-947e38426e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.552533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc653b-68fc-49a8-8ade-947e38426e2f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.552718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc653b-68fc-49a8-8ade-947e38426e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.553897 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc653b-68fc-49a8-8ade-947e38426e2f None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.554828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc653b-68fc-49a8-8ade-947e38426e2f None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:41.556691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc653b-68fc-49a8-8ade-947e38426e2f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:41.563261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 181/361] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:41.563261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882fa3-34ba-43a9-9eed-f1c80de5aaa7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.563261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882fa3-34ba-43a9-9eed-f1c80de5aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.563261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882fa3-34ba-43a9-9eed-f1c80de5aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.581412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-0c882fa3-34ba-43a9-9eed-f1c80de5aaa7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:41.582916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0c882fa3-34ba-43a9-9eed-f1c80de5aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:41.652775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fdade-133b-4d2a-9b4e-3e8ce6ad5ce6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:41.689947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 182/362] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:41.690135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:41.690385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882fa3-34ba-43a9-9eed-f1c80de5aaa7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:41.712191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.713044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.713409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.713814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.714608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:41.714917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:41.716476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:41.723928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:41.729087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 181/363] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:41.731166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:41.891167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882fa3-34ba-43a9-9eed-f1c80de5aaa7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:41.916859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06887d-f7aa-4f54-945a-ea2c8091d38d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:41.946616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.948135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.948880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.951234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.976066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:41.977041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:41.977545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:41.977740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:41.978203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:41.989416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:41.990345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:41.991138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:41.991751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 183/364] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:41.995373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:42.061994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:42.080433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:42.081664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:42.146961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:42.170717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bdad-a2c1-4f9a-aeba-669c2e4ef8c2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:42.222724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:42.223349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:42.223630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:42.223987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:42.224716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:42.225050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:42.226661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:42.235248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 184/365] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:42.236801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:42.243366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 182/366] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:42.244254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:42.391859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:42.399913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447bc31-3019-45f4-bed9-cd66a1083a13 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:42.412683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a45ae-507c-4faa-a950-102c9c72884b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:42.462716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:42.463397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:42.463952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:42.464224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:42.464955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:42.466295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:42.467938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:42.482328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 185/367] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:42.483239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:42.484213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:42.485385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:42.485912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:42.486355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:42.498639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:42.507206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:42.512834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:42.513881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 183/368] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:42.514755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:42.651314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208cc9-b17f-498d-9c3f-ac08827ac79e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:42.702652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b83010-4e72-4ebf-9548-763e2247ee9f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:42.715256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:42.716823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:42.717177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:42.717461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:42.718710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:42.721253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:42.724885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 186/369] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:42 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:42.725891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:42.770515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:42.771141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:42.771418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:42.771689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:42.795765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:42.861392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:42.875520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:42.877347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:42.894845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba763ad1-10fa-4edc-ac84-e5c6e5a0e5f0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:42.935039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:42.935642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:42.935931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:42.936209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:42.937073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:42.937365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:42.938892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:42.951614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 187/370] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:42.952535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:43.010949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 184/371] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:43.012371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:43.078356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:43.152015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0393a5-3102-4685-89f1-969644892d80 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:43.158573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e53027-6c93-40de-9932-41bf2cef96a1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:43.199259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:43.200067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:43.200355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:43.200945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:43.202272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:43.204982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:43.206103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:43.206889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:43.207308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:43.207734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:43.211983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 188/372] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:42 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:43.212778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:43.217005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:43.299309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:43.301346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:43.338000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c9e58-53a9-4c65-bac6-131eda74b33a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:43.364401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:43.386813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:43.387764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:43.388234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:43.388732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:43.390492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:43.392322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:43.395573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 189/373] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:43 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:43.396700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:43.447735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 185/374] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:43.448624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:43.508543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:43.575749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09829b-3c47-4f90-a07f-24d6845575bd None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:43.607067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae75de-90b6-4d8d-96bc-c27043b29a83 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:43.638228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:43.639342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:43.639846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:43.640323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:43.641738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=5565ecc493584acf98865b488c38a86e) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:43.642322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:43.645166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:43.652695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:43.653726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:43.654210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:43.654683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:43.656099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 190/375] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:43 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:43.656532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:43.657830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:43.658604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:43.661091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 186/376] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:43 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:43.667246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:43.704449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:43.821874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e73e5-cfe2-4972-8a1b-c77cd144341f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:43.873388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:43.874387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:43.874748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:43.875099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:43.875941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=5565ecc493584acf98865b488c38a86e) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:43.876263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:43.877944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:43.885035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 187/377] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:43 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:43.887939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c75be-c7c5-4257-98f4-e292dcfdd1c6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:43.940128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:43.940828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:43.941498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:43.941845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] PATH_INFO: `/v3/projects/635783c99cd6429c8d3d3df5393b1353` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:43.943433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] RBAC: Authorizing `identity:get_project(project_id=635783c99cd6429c8d3d3df5393b1353)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:43.944996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:43.947066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 191/378] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:43 2022] GET /identity/v3/projects/635783c99cd6429c8d3d3df5393b1353 => generated 344 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:43.954312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:44.060015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:44.091892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e85ff1-0ba1-4503-ac87-123e786875a6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:44.133039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da72368-d3b6-4092-af2a-cc18aa68e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:44.133738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da72368-d3b6-4092-af2a-cc18aa68e63f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:44.134021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da72368-d3b6-4092-af2a-cc18aa68e63f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:44.137106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da72368-d3b6-4092-af2a-cc18aa68e63f None admin] PATH_INFO: `/v3/groups/a73472dca84a4e228d02240a8719dc27` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:44.141609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da72368-d3b6-4092-af2a-cc18aa68e63f None admin] RBAC: Authorizing `identity:get_group(group_id=a73472dca84a4e228d02240a8719dc27)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:44.143125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da72368-d3b6-4092-af2a-cc18aa68e63f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:44.146039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 188/379] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:43 2022] GET /identity/v3/groups/a73472dca84a4e228d02240a8719dc27 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:44.157095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:44.172326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:44.236402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342a92-ab5a-4240-9a62-b9bc106c1af9 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:44.236801 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342a92-ab5a-4240-9a62-b9bc106c1af9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:44.237114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342a92-ab5a-4240-9a62-b9bc106c1af9 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:44.239177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 189/380] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:44.246790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459657-4868-4917-8c1a-57f7750d472e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:44.247110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459657-4868-4917-8c1a-57f7750d472e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:44.247347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459657-4868-4917-8c1a-57f7750d472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:44.280212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c2459657-4868-4917-8c1a-57f7750d472e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:44.281513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c2459657-4868-4917-8c1a-57f7750d472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:44.336503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1a14-ca26-4b27-88e8-030ef6b660b2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:44.377204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:44.379055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:44.379542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:44.380071 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:44.381489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] RBAC: Adding query filter params (group.id=a73472dca84a4e228d02240a8719dc27, role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=635783c99cd6429c8d3d3df5393b1353) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:44.382159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:44.383893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:44.395297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 192/381] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:44 2022] GET /identity/v3/role_assignments?group.id=a73472dca84a4e228d02240a8719dc27&scope.project.id=635783c99cd6429c8d3d3df5393b1353&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:44.400823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 190/382] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:44.880312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:44.887530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340ea44-9727-4cdc-8cf9-f0c7732f7215 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:44.888006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340ea44-9727-4cdc-8cf9-f0c7732f7215 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:44.888078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340ea44-9727-4cdc-8cf9-f0c7732f7215 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:44.894021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 191/383] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:44.897047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abfb6-1a77-4c50-a3a9-34a36aa19cfa None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:44.897349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abfb6-1a77-4c50-a3a9-34a36aa19cfa None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:44.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abfb6-1a77-4c50-a3a9-34a36aa19cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:44.940045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5b1abfb6-1a77-4c50-a3a9-34a36aa19cfa None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:44.947305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5b1abfb6-1a77-4c50-a3a9-34a36aa19cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:45.021446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:45.089074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f2a5-aa9b-4b5d-970d-52edee38f985 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:45.102946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 192/384] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:45.139719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:45.140439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:45.140726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:45.141002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:45.159676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:45.169946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:45.170933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:45.171741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 193/385] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:45.177704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1abfb6-1a77-4c50-a3a9-34a36aa19cfa None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:45.183346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:45.329666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1abfb6-1a77-4c50-a3a9-34a36aa19cfa None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:45.374069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:45.374595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:45.374869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:45.375135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:45.375800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:45.376096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:45.377587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:45.388840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 193/386] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:45.394751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:45.470172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:45.544295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f53e-1a68-4143-ba99-7116f60456d6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:45.583550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:45.590597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:45.605994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:45.605994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:45.605994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:45.605994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:45.605994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:45.605994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 194/387] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:45 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:45.606398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:45.637692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:45.711455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92577ec9-9f17-4ee7-9209-7487fe045e0d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:45.743570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3a39d-9ab6-4517-af1c-df902499736b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:45.791506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:45.792245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:45.792526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:45.792801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:45.796108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:45.797666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:45.800074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 195/388] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:45 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:45.808324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:45.809042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:45.809344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:45.809550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:45.809663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:45.840896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:45.857813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:45.858656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:45.859417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:45.860464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 194/389] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:45.870719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:45.902142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:45.946976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17098082-6dbf-42ac-a083-15850c98c16d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:46.088319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf4d05-43f8-4160-bce1-33923a42674b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:46.103000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:46.104052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.104505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.104952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/groups/235b5898ee23453bb9b790cfcbbc5489/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.114426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1451db3bbc14b4fa50d8499a2de18b8, group_id=235b5898ee23453bb9b790cfcbbc5489, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:46.117154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:46.136012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:46.148975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:46.150035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.150526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.151004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.152251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:46.152743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:46.155350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:46.172243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 195/390] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:46.179256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:46.261369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 196/391] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 21:08:45 2022] PUT /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/groups/235b5898ee23453bb9b790cfcbbc5489/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:46.328025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5ef75-0f59-4e41-98c2-1e271cd0da95 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:46.385465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e14fb9-eb82-4bf4-b240-9ef53aaea162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:46.387048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e14fb9-eb82-4bf4-b240-9ef53aaea162 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.387565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e14fb9-eb82-4bf4-b240-9ef53aaea162 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.388214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e14fb9-eb82-4bf4-b240-9ef53aaea162 None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.390337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e14fb9-eb82-4bf4-b240-9ef53aaea162 None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:46.392821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e14fb9-eb82-4bf4-b240-9ef53aaea162 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:46.401736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:46.402392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 196/392] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:46 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:46.522666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf977-9201-4d53-95e9-e6578f576fce None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.523286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf977-9201-4d53-95e9-e6578f576fce None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.523775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf977-9201-4d53-95e9-e6578f576fce None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.525766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 197/393] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:46.532667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8be2bc-ac10-4bc8-b94c-13fe90bf1224 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.533301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8be2bc-ac10-4bc8-b94c-13fe90bf1224 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.533803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8be2bc-ac10-4bc8-b94c-13fe90bf1224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.554390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b608-9d34-41ba-ba50-7f19f14f9588 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:46.559297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0c8be2bc-ac10-4bc8-b94c-13fe90bf1224 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:46.560507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0c8be2bc-ac10-4bc8-b94c-13fe90bf1224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:46.581891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:46.593153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9138f-a66a-4b51-9cb1-2ca58ea42045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:46.593994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9138f-a66a-4b51-9cb1-2ca58ea42045 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.594929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9138f-a66a-4b51-9cb1-2ca58ea42045 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.594929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9138f-a66a-4b51-9cb1-2ca58ea42045 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.595734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9138f-a66a-4b51-9cb1-2ca58ea42045 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:46.597357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9138f-a66a-4b51-9cb1-2ca58ea42045 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:46.599378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 197/394] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:46 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:46.600759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb4df-0783-49a1-b1b2-6d06ba94ad65 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.601338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb4df-0783-49a1-b1b2-6d06ba94ad65 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.601766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb4df-0783-49a1-b1b2-6d06ba94ad65 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.607230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 198/395] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:46.607230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb4df-0783-49a1-b1b2-6d06ba94ad65 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:46.625147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:46.646089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 198/396] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:46.648009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5aac2-02bf-4b9d-bb0b-aa531b807c2d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.648486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5aac2-02bf-4b9d-bb0b-aa531b807c2d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.648944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5aac2-02bf-4b9d-bb0b-aa531b807c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.668258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-70b5aac2-02bf-4b9d-bb0b-aa531b807c2d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:46.669912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-70b5aac2-02bf-4b9d-bb0b-aa531b807c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:46.753398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 199/397] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:46.765664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb4df-0783-49a1-b1b2-6d06ba94ad65 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:46.830546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:46.831830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.832119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.832492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/groups/235b5898ee23453bb9b790cfcbbc5489/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.841906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] RBAC: Authorizing `identity:create_grant(project_id=e1451db3bbc14b4fa50d8499a2de18b8, group_id=235b5898ee23453bb9b790cfcbbc5489, role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:46.843417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:46.945183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc4e6-7466-4936-8aa3-ef3a21be6834 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.945397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc4e6-7466-4936-8aa3-ef3a21be6834 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.945668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc4e6-7466-4936-8aa3-ef3a21be6834 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.947009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 200/398] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:08:46.952984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1352d3-adfe-478f-8134-afc7e756eb38 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:46.953340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1352d3-adfe-478f-8134-afc7e756eb38 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:46.953713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1352d3-adfe-478f-8134-afc7e756eb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:46.959412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 199/399] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 21:08:46 2022] PUT /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8/groups/235b5898ee23453bb9b790cfcbbc5489/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:46.983711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ca1352d3-adfe-478f-8134-afc7e756eb38 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:46.985045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ca1352d3-adfe-478f-8134-afc7e756eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:47.008071 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.116127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:47.141146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 201/400] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:47.142834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1352d3-adfe-478f-8134-afc7e756eb38 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.184632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81378bbb-4c5d-4c00-bdc3-c175182320fb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:47.220717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:47.229175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:47.234212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:47.234212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:47.234212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:47.245728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:47.252341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:47.254038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:47.254896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:47.257041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 200/401] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:47.268792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.283477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1352d3-adfe-478f-8134-afc7e756eb38 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:47.351576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:47.352772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:47.353288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:47.353784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:47.375994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:47.385272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:47.386218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:47.387035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:47.391351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 202/402] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:47.398594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.474262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6768b9-12fa-49b7-ba96-10244d3e99c4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:47.493505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:47.522643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:47.523622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:47.524146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:47.524625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:47.526333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:47.526884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:47.529008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:47.542004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 201/403] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:47.543341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.556307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bea0f7-6114-4067-9d95-29d207d57876 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:47.561168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:47.603352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:47.603995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:47.604385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:47.604664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:47.606108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:47.606627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:47.609315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:47.633556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 203/404] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:47.635378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.673186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd101ac-b189-4f4c-b3ae-879cbf9184af None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:47.715698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:47.716454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:47.716754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:47.717213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:47.729780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:47.735312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:47.736248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:47.737591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 202/405] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:47.738225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.786041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:47.788202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db961dd5-fb3c-4218-8273-3ff7b615b371 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:47.837407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:47.838041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:47.838319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:47.838587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:47.841601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:47.843138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:47.844867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 204/406] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:47.849165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.889573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b6fd4-d71b-4e92-8995-b13f4d9e293c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:47.896850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:47.953493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:47.955072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:47.955885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:47.956482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:47.958753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:47.961915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:47.966044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 203/407] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:47.972638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:47.976100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a5f83-d2f3-472e-951d-35a9eb53812f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:48.022938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:48.023966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.024351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.024672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.025505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:48.025874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:48.027577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:48.047430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 205/408] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:48.047430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:48.124885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f635b58-b612-42a1-8616-c9ff8b72f1b0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:48.127696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:48.174010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:48.175261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.176365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.176715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.178063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:48.179710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:48.186631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 204/409] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:47 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:48.187594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:48.208429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:48.224589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dbe51-a00c-455e-9852-4b84c912404d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:48.274684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:48.275968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.276764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.277271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.278934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:48.281272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:48.284537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 206/410] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:48 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:48.285884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:48.367847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad195c0-e8fb-496d-b174-408155fca125 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:48.409631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:48.410391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.410824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.411025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] PATH_INFO: `/v3/groups/a73472dca84a4e228d02240a8719dc27` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.412486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] RBAC: Authorizing `identity:get_group(group_id=a73472dca84a4e228d02240a8719dc27)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:48.414261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:48.420887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 205/411] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:48 2022] GET /identity/v3/groups/a73472dca84a4e228d02240a8719dc27 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:48.420887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:48.422810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c8c5-5293-47c5-83c4-2b27b239c3e8 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:48.469987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:48.470770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.471234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.472152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e/groups/235b5898ee23453bb9b790cfcbbc5489/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.473360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:48.474968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] RBAC: Authorizing `identity:create_grant(project_id=5565ecc493584acf98865b488c38a86e, group_id=235b5898ee23453bb9b790cfcbbc5489, role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:48.476725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:48.546722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89834f-c5d2-4a0a-af8e-972c9bc94995 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:48.586451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aad56-9a7f-4cdc-8d3f-832ef41e90e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:48.587112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aad56-9a7f-4cdc-8d3f-832ef41e90e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.587404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aad56-9a7f-4cdc-8d3f-832ef41e90e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.587681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aad56-9a7f-4cdc-8d3f-832ef41e90e6 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e/groups/235b5898ee23453bb9b790cfcbbc5489/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.589770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aad56-9a7f-4cdc-8d3f-832ef41e90e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5565ecc493584acf98865b488c38a86e, group_id=235b5898ee23453bb9b790cfcbbc5489, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:48.591234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aad56-9a7f-4cdc-8d3f-832ef41e90e6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:48.635749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 207/412] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 21:08:48 2022] PUT /identity/v3/projects/5565ecc493584acf98865b488c38a86e/groups/235b5898ee23453bb9b790cfcbbc5489/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:48.636630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:48.670866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:48.716913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 206/413] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 21:08:48 2022] PUT /identity/v3/projects/5565ecc493584acf98865b488c38a86e/groups/235b5898ee23453bb9b790cfcbbc5489/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:48.719181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847635a4-a530-4177-b5c3-e5326281c813 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.720033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847635a4-a530-4177-b5c3-e5326281c813 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.720551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847635a4-a530-4177-b5c3-e5326281c813 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.723297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 207/414] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:48.743324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5dc0c-88b7-4064-af56-4c0fd98e2cf1 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.743951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5dc0c-88b7-4064-af56-4c0fd98e2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.744432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5dc0c-88b7-4064-af56-4c0fd98e2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.789532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-8eb5dc0c-88b7-4064-af56-4c0fd98e2cf1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:48.791242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8eb5dc0c-88b7-4064-af56-4c0fd98e2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:48.794620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14806-cc71-407d-8bad-522335d80d42 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:48.856695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:48.856695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:48.856695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:48.856695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] PATH_INFO: `/v3/projects/635783c99cd6429c8d3d3df5393b1353` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:48.857138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=635783c99cd6429c8d3d3df5393b1353)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:48.857401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:48.860473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 208/415] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:48 2022] GET /identity/v3/projects/635783c99cd6429c8d3d3df5393b1353 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:48.867619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:48.887945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 208/416] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:49.007573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:49.018060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7d02e-de00-4e2f-9c4d-3a29b1eaa2c9 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:49.057251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdb9a0-fe05-4c40-b131-03c4306d386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:49.057927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb9a0-fe05-4c40-b131-03c4306d386f None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:49.058202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb9a0-fe05-4c40-b131-03c4306d386f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:49.058472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb9a0-fe05-4c40-b131-03c4306d386f None admin] PATH_INFO: `/v3/projects/635783c99cd6429c8d3d3df5393b1353/groups/a73472dca84a4e228d02240a8719dc27/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:49.060486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdb9a0-fe05-4c40-b131-03c4306d386f None admin] RBAC: Authorizing `identity:create_grant(project_id=635783c99cd6429c8d3d3df5393b1353, group_id=a73472dca84a4e228d02240a8719dc27, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:49.061971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdb9a0-fe05-4c40-b131-03c4306d386f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:49.162668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 209/417] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 21:08:48 2022] PUT /identity/v3/projects/635783c99cd6429c8d3d3df5393b1353/groups/a73472dca84a4e228d02240a8719dc27/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:08:49.172012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb4eee-0177-41a9-b188-09707e233545 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:49.172543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb4eee-0177-41a9-b188-09707e233545 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:49.172823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb4eee-0177-41a9-b188-09707e233545 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:49.175591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 209/418] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:49.183322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69e4c-53e6-4de0-a09e-8b8b4c4677b2 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:49.183636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69e4c-53e6-4de0-a09e-8b8b4c4677b2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:49.183879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69e4c-53e6-4de0-a09e-8b8b4c4677b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:49.213297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-80d69e4c-53e6-4de0-a09e-8b8b4c4677b2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:49.214608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-80d69e4c-53e6-4de0-a09e-8b8b4c4677b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:49.245168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb4eee-0177-41a9-b188-09707e233545 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:49.317506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:49.376900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 210/419] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:49.447644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb4eee-0177-41a9-b188-09707e233545 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:49.504120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:49.505186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:49.505698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:49.506180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:49.519559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:49.526208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:49.527195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:49.527987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:49.530976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 210/420] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:49.538860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69e4c-53e6-4de0-a09e-8b8b4c4677b2 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:49.681659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:49.707396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69e4c-53e6-4de0-a09e-8b8b4c4677b2 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:49.758852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:49.759479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:49.759755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:49.760022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:49.760764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:49.761095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:49.762200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:49.762488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:49.780900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 211/421] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:49.786877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:49.945554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:49.967476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059524-427c-4449-8171-70cc9b3822fd None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:50.037137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:50.038616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:50.039355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:50.040160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:50.072570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:50.097621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0152bd-5fb8-44bb-99d4-ea82dfb455f5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:50.098490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:50.100210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:50.101723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:50.105841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 211/422] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:50.114156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:50.215766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:50.217924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:50.227231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:50.228066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:50.274286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:50.379597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:50.382372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:50.483320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eddf5b-567f-45dc-b573-faf74c9ea5db None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:50.560621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:50.561326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:50.561658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:50.562131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:50.562900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:50.563210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:50.564815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:50.587194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 212/423] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:08:50.587442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 212/424] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:50.594275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:50.595802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:50.634109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:50.674352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:50.795435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06d0e2-d2d3-4b74-90d1-ec5090aa886c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:50.810752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4fa4-936d-419e-82a5-d42b49053e6b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:50.881246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:50.882485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:50.883024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:50.883556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:50.918710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:50.919367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:50.919694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:50.919967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:50.923262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:50.925171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:50.927707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 213/425] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:50 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:50.935431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:50.974714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:50.977160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:51.036836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:51.104465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 213/426] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:51.111673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:51.222719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:51.257250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97bd83-5498-4789-8163-0e63e2e20c83 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:51.261705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18c2f8-5e68-43bd-91ff-4a3310a82516 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:51.293557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:51.294170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.294449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.294720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] PATH_INFO: `/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.301633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] RBAC: Authorizing `identity:get_project(project_id=e1451db3bbc14b4fa50d8499a2de18b8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:51.301633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:51.301633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 214/427] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:51 2022] GET /identity/v3/projects/e1451db3bbc14b4fa50d8499a2de18b8 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:51.314218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:51.332590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:51.333633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.334219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.334984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.335648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:51.340120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:51.342168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:51.350990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 214/428] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:50 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:51.357239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:51.437420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa129211-247e-40fb-9305-1baa0e1cb5cd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:51.483912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:51.484943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.488615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.489565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.492368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:51.493871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:51.496005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 215/429] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:51 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:51.503078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:51.594358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78972f7c-c8fa-42da-b9d8-498b43d515d1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:51.602218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:51.629845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3bda3-287f-4f0b-8e11-9f8b6ed036ff None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:51.636972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259296ce-9ff0-4627-83e4-f9e6b67912d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:51.637767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259296ce-9ff0-4627-83e4-f9e6b67912d2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.638052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259296ce-9ff0-4627-83e4-f9e6b67912d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.638314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259296ce-9ff0-4627-83e4-f9e6b67912d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.639046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259296ce-9ff0-4627-83e4-f9e6b67912d2 None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:51.639357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259296ce-9ff0-4627-83e4-f9e6b67912d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:51.640811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259296ce-9ff0-4627-83e4-f9e6b67912d2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:51.647451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 215/430] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:51 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 611 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:51.648704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ee8b7-6480-4542-806a-341953075262 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.648965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ee8b7-6480-4542-806a-341953075262 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.649270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ee8b7-6480-4542-806a-341953075262 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.650501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 216/431] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:51.654777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde92eac-33a5-4906-ad53-67054eb0b9a4 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.654777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde92eac-33a5-4906-ad53-67054eb0b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.654777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde92eac-33a5-4906-ad53-67054eb0b9a4 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.654777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 217/432] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:51.659269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3f14-db7e-4b6c-8061-e76bec74077d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.659526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3f14-db7e-4b6c-8061-e76bec74077d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.659807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3f14-db7e-4b6c-8061-e76bec74077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.681395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e8ea3f14-db7e-4b6c-8061-e76bec74077d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:51.683121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e8ea3f14-db7e-4b6c-8061-e76bec74077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:51.685505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9481573-b467-47b9-a01b-d02f29c17de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:51.686269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481573-b467-47b9-a01b-d02f29c17de2 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.686591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481573-b467-47b9-a01b-d02f29c17de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.686870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481573-b467-47b9-a01b-d02f29c17de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.687836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:51.687983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9481573-b467-47b9-a01b-d02f29c17de2 None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:51.688767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9481573-b467-47b9-a01b-d02f29c17de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:51.690773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9481573-b467-47b9-a01b-d02f29c17de2 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:51.698416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 216/433] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:51 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=e1451db3bbc14b4fa50d8499a2de18b8&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:51.708273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d234ba-391a-446e-ae44-c6028c0e4f6c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.708273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d234ba-391a-446e-ae44-c6028c0e4f6c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.708273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d234ba-391a-446e-ae44-c6028c0e4f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.721245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a3d234ba-391a-446e-ae44-c6028c0e4f6c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:51.722642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a3d234ba-391a-446e-ae44-c6028c0e4f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:51.786192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 218/434] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:51.881191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 217/435] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:51.897421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dddf8a-e505-4a80-a975-2ec90095f0c7 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.897708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dddf8a-e505-4a80-a975-2ec90095f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.898020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dddf8a-e505-4a80-a975-2ec90095f0c7 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.900678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 219/436] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:51.905101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f02c69-2838-44aa-8092-d3c7ba51e548 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:51.905361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f02c69-2838-44aa-8092-d3c7ba51e548 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:51.905637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f02c69-2838-44aa-8092-d3c7ba51e548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:51.926826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-50f02c69-2838-44aa-8092-d3c7ba51e548 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:51.928041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-50f02c69-2838-44aa-8092-d3c7ba51e548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:52.016942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 218/437] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:52.082691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dddf8a-e505-4a80-a975-2ec90095f0c7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.186159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f02c69-2838-44aa-8092-d3c7ba51e548 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.189847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:52.208801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dddf8a-e505-4a80-a975-2ec90095f0c7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.260389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.261035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.261365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.261632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:52.271869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:52.274904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:52.282403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:52.283523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:52.285211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 220/438] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:08:52.290651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.324229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f02c69-2838-44aa-8092-d3c7ba51e548 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.368898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.369616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.369898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.370174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:52.384366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:52.389438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:52.390510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:52.391434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 219/439] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:08:52.392486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.437987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b566fb-3835-4ee8-8dbd-74ba1ef6bb2b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.488100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:52.490968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.491928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.503302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.503302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:52.503302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:52.503302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:52.503302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:52.507930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 221/440] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:08:52.508795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.534487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7dcf-97d1-4b5b-b84c-a7490948ebb0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.570966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.571617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.571900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.572173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:52.577915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:52.584105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:08:52.589662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:52.613749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 220/441] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:52.614516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.626571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8ff34-3332-4532-8ac2-651798b2ca4e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.666943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.667553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.667830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.668107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:52.668772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] RBAC: Adding query filter params (name=member) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:52.669141 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:52.670554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:52.680304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 222/442] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:52.680778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.713537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becd0b8-de4d-4440-97e7-e2f337580b09 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.739716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:52.750427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.765575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.765575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.765575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:52.787781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfc5f0-3243-48fb-a693-bbd5869a1349 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.811870 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:52.824567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.840041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.840041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.840041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:52.840041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:52.840041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:52.840041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:52.840539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:52.840539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:52.840698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 223/443] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:52.840698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.949136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 221/444] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:52.949990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:52.960018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0fe08-1c50-4ac0-a670-8ae54f4e580f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:52.978516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:52.998686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:52.999300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:52.999584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:52.999860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.058388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639622-7910-4ec0-89f9-92bdf27ff757 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.061895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.075979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.077483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.094421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.095043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.095322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.095593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.171344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.172953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.188328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 224/445] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:53.189343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.205942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.287634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 222/446] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:08:53.288487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.292421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.308609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d4f98-5701-458b-814a-47a6e60a0f86 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.345497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.346182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.346471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.346748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.347902 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.349420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.351084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 225/447] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.351874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.400276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b6cd2-888d-4f2b-8b66-952bf3026225 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.424155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.435437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.436383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.436646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.436922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] PATH_INFO: `/v3/projects/5565ecc493584acf98865b488c38a86e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.438102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] RBAC: Authorizing `identity:get_project(project_id=5565ecc493584acf98865b488c38a86e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.439555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.442200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 223/448] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/projects/5565ecc493584acf98865b488c38a86e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.442786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.462566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33f69-552f-46a1-8cd9-5d4c0a081f76 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.499436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.500085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.500335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.500618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] PATH_INFO: `/v3/projects/635783c99cd6429c8d3d3df5393b1353` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.501825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] RBAC: Authorizing `identity:get_project(project_id=635783c99cd6429c8d3d3df5393b1353)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.503920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.505599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 226/449] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/projects/635783c99cd6429c8d3d3df5393b1353 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.506365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.533111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.566896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3294b3-ac9c-4c7f-b6d9-ccff4d0cfc10 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.609407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.610077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.610356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.610629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.611881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.613914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.615508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 224/450] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.616282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.628191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425daccf-2ec5-4f85-855f-4dd20d9bb08a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.665197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.665829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.666109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.666380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] PATH_INFO: `/v3/groups/235b5898ee23453bb9b790cfcbbc5489` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.667520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] RBAC: Authorizing `identity:get_group(group_id=235b5898ee23453bb9b790cfcbbc5489)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.668978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.670586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 227/451] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/groups/235b5898ee23453bb9b790cfcbbc5489 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.671359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.684365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.733412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ebacc-2fa8-4d29-bf81-45dfcd33154a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.772809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.773476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.773754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.774064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] PATH_INFO: `/v3/groups/a73472dca84a4e228d02240a8719dc27` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.775215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] RBAC: Authorizing `identity:get_group(group_id=a73472dca84a4e228d02240a8719dc27)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.776675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.778372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 225/452] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/groups/a73472dca84a4e228d02240a8719dc27 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.779220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.782450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.794593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaa703-8da1-4315-8e78-1432c92aaff4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.832719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.833290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.833623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.833902 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.834646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=5565ecc493584acf98865b488c38a86e) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:53.834953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.836529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.842824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 228/453] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.843645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:53.914457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8006eb-f0b8-4080-bae8-84e449a6c052 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:53.950087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:53.962397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27d9b6-d258-4d14-998e-3a598e4749da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:53.963049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27d9b6-d258-4d14-998e-3a598e4749da None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:53.963330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27d9b6-d258-4d14-998e-3a598e4749da None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:53.963602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27d9b6-d258-4d14-998e-3a598e4749da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:53.964369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27d9b6-d258-4d14-998e-3a598e4749da None admin] RBAC: Adding query filter params (group.id=235b5898ee23453bb9b790cfcbbc5489, role.id=63e30c687d4b49118bf8ec5f3341f560, scope.project.id=5565ecc493584acf98865b488c38a86e) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:53.964689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27d9b6-d258-4d14-998e-3a598e4749da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:53.967434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27d9b6-d258-4d14-998e-3a598e4749da None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:53.977660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 226/454] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/role_assignments?group.id=235b5898ee23453bb9b790cfcbbc5489&scope.project.id=5565ecc493584acf98865b488c38a86e&role.id=63e30c687d4b49118bf8ec5f3341f560 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:53.985552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8b59-4e0c-41d6-ac76-b9777bfa8fdb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:54.044985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5ac14-7683-4e07-82b9-afd7d32e16ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:54.045655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ac14-7683-4e07-82b9-afd7d32e16ff None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:54.045946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ac14-7683-4e07-82b9-afd7d32e16ff None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:54.046200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ac14-7683-4e07-82b9-afd7d32e16ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:54.046962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5ac14-7683-4e07-82b9-afd7d32e16ff None admin] RBAC: Adding query filter params (group.id=a73472dca84a4e228d02240a8719dc27, role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=635783c99cd6429c8d3d3df5393b1353) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:54.047273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5ac14-7683-4e07-82b9-afd7d32e16ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:54.048781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5ac14-7683-4e07-82b9-afd7d32e16ff None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:54.056753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 229/455] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 21:08:53 2022] GET /identity/v3/role_assignments?group.id=a73472dca84a4e228d02240a8719dc27&scope.project.id=635783c99cd6429c8d3d3df5393b1353&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:56.809574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd0bbb-82e8-45df-b6c5-0b228576cd54 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:56.810571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd0bbb-82e8-45df-b6c5-0b228576cd54 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:56.811070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd0bbb-82e8-45df-b6c5-0b228576cd54 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:56.812962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 227/456] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:56.819602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df293-a130-45b5-a0c3-a2d68e0d2def None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:56.820099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df293-a130-45b5-a0c3-a2d68e0d2def None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:56.820531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df293-a130-45b5-a0c3-a2d68e0d2def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:56.852198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f85df293-a130-45b5-a0c3-a2d68e0d2def None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:56.853472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f85df293-a130-45b5-a0c3-a2d68e0d2def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:56.872127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:56.956370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 230/457] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:08:57.076838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a124-7e06-4b18-92d9-e66d197b2df8 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.077480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a124-7e06-4b18-92d9-e66d197b2df8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.077982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a124-7e06-4b18-92d9-e66d197b2df8 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 228/458] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:57.086012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6654b-99f5-4eb1-a3bf-168d825ebed8 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.086289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6654b-99f5-4eb1-a3bf-168d825ebed8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.086742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6654b-99f5-4eb1-a3bf-168d825ebed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.114283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-53b6654b-99f5-4eb1-a3bf-168d825ebed8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:57.115758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-53b6654b-99f5-4eb1-a3bf-168d825ebed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:57.241186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 231/459] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:57.272676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442a124-7e06-4b18-92d9-e66d197b2df8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:57.420684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb81d-85ab-4542-928e-d99578f33387 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.421501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb81d-85ab-4542-928e-d99578f33387 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.422004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb81d-85ab-4542-928e-d99578f33387 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.423648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 232/460] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:08:57.425508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbcadd-babf-4dfa-8fb2-9538b95c7669 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.426052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbcadd-babf-4dfa-8fb2-9538b95c7669 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.426233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442a124-7e06-4b18-92d9-e66d197b2df8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:57.426726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbcadd-babf-4dfa-8fb2-9538b95c7669 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.428209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 233/461] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:57.434097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5945f-ee3a-4101-a704-21d4494265ad None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.434705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5945f-ee3a-4101-a704-21d4494265ad None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.435206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5945f-ee3a-4101-a704-21d4494265ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.456016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-82f5945f-ee3a-4101-a704-21d4494265ad None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:57.457630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-82f5945f-ee3a-4101-a704-21d4494265ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:57.485959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b5d53-938f-4f62-92a3-616c5e509880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:57.487205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b5d53-938f-4f62-92a3-616c5e509880 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.487688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b5d53-938f-4f62-92a3-616c5e509880 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.488303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b5d53-938f-4f62-92a3-616c5e509880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.502905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b5d53-938f-4f62-92a3-616c5e509880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:57.504740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b5d53-938f-4f62-92a3-616c5e509880 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-888b5d53-938f-4f62-92a3-616c5e509880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:08:57.524122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:57.525546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:08:57.526799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:08:57.526799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:57.526799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:57.529121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 229/462] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:08:57.530920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e919a-7b4a-4ed6-9c71-566d1f62e91a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.531379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e919a-7b4a-4ed6-9c71-566d1f62e91a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.532035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e919a-7b4a-4ed6-9c71-566d1f62e91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.541818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 234/463] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:57.550219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5945f-ee3a-4101-a704-21d4494265ad None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:57.561753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:57.563853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-be9e919a-7b4a-4ed6-9c71-566d1f62e91a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:57.565478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-be9e919a-7b4a-4ed6-9c71-566d1f62e91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:57.613788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:57.651110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 230/464] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:57.652277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e919a-7b4a-4ed6-9c71-566d1f62e91a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:57.674895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5945f-ee3a-4101-a704-21d4494265ad None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:57.765459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:57.766087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.766372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.766643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.767287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:57.767647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:57.769548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:57.788656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 235/465] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:57.794615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:57.804576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e919a-7b4a-4ed6-9c71-566d1f62e91a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:57.863854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:57.864503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:57.864771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:57.865037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:57.876390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:57.878436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:08:57.897207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:57.898283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:08:57.899139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:08:57.899139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:57.899139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:57.899139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 231/466] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:57.899681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:57.911215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:57.930601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:57.956747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e879f-14cc-4071-bf28-f41b870a9518 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.001344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.002038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.002504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.002786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.003452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.004917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.014597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c87418-4afe-4501-bf77-4851032d15e6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.051662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.052302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.052579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.052849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.064935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.066739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:08:58.083112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:58.084257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:08:58.085133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:08:58.085133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:58.085133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:08:58.085133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 232/467] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:58.085133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:58.139474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 236/468] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:57 2022] POST /identity/v3/users => generated 246 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:58.150230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:58.191925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:58.227323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45d6be-58f3-4065-b99b-c8a4977e633e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.275227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.276248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.276734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.277285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.278164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:58.278695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.280494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.295506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 233/469] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:58.296693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:58.301557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117347-ceef-4657-ab9f-3135249ece6e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.348112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:58.367669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.368748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.369284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.369775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.394761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.397757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.424560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d5cf-0926-419a-a344-784c4545fbfe None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:08:58.427891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:08:58.428814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:08:58.429674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:08:58.429674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:08:58.429674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:58.431296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 237/470] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:58.433466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:58.466848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.467431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.467673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.467945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.468596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:58.468924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.470404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.478703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:58.487550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 234/471] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:58.491029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:58.598905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ae77-eda8-4bad-9a28-7c464d121de0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.615037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef924854-540c-4ee4-8a8d-8bddd8075cfa None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.640311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f34c5c-7b38-494a-9416-7ef16ff943ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.640942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34c5c-7b38-494a-9416-7ef16ff943ab None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.641505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34c5c-7b38-494a-9416-7ef16ff943ab None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.641505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34c5c-7b38-494a-9416-7ef16ff943ab None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.642223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f34c5c-7b38-494a-9416-7ef16ff943ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:08:58.642510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f34c5c-7b38-494a-9416-7ef16ff943ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.644514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f34c5c-7b38-494a-9416-7ef16ff943ab None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.658106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.658755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.659069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.659342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.660009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.661677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.664534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 235/472] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:08:58.666107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce612c-818f-4f8e-8493-5c1c728046f2 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.666374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce612c-818f-4f8e-8493-5c1c728046f2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.666649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce612c-818f-4f8e-8493-5c1c728046f2 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.668154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 236/473] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:08:58.668844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce612c-818f-4f8e-8493-5c1c728046f2 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:58.737539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:58.801104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 238/474] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:58 2022] POST /identity/v3/users => generated 248 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:58.801104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:58.802433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce612c-818f-4f8e-8493-5c1c728046f2 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:58.855961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204057f4-02a5-4b8f-a238-f4ed68d03afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:58.857139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204057f4-02a5-4b8f-a238-f4ed68d03afc None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:58.857580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204057f4-02a5-4b8f-a238-f4ed68d03afc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:58.861087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204057f4-02a5-4b8f-a238-f4ed68d03afc None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:58.861087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204057f4-02a5-4b8f-a238-f4ed68d03afc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:58.861087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204057f4-02a5-4b8f-a238-f4ed68d03afc None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:58.866169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:58.983321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe0036-e2b8-4c20-aa61-3c8699922633 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:59.033700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:59.034674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:59.034674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:59.035155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:59.036590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:59.037627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:59.178719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 237/475] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:58 2022] POST /identity/v3/users => generated 249 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:59.180039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe4fec-a615-401d-a605-1b95ce175318 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:59.180366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe4fec-a615-401d-a605-1b95ce175318 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:59.180646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe4fec-a615-401d-a605-1b95ce175318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:59.203620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e3fe4fec-a615-401d-a605-1b95ce175318 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:08:59.204953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e3fe4fec-a615-401d-a605-1b95ce175318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:08:59.229132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 239/476] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:08:58 2022] POST /identity/v3/users => generated 248 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:08:59.311531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 238/477] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:08:59.649896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:08:59.779488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:08:59.797852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59446-c34a-4e1e-add7-f2bc60d1d01d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:08:59.848849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:08:59.850164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:08:59.850781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:08:59.851381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:08:59.852609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:08:59.854741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:08:59.949484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.sql.core [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:08:59.949484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 21:08:59.949484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [parameters: {'id': '639235218cc64687815db4b61f1a976d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 21:08:59.949484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81932) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application result.read() Aug 29 21:08:59.966061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:08:59.967013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application yield resource Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise self.value Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application session.commit() Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:08:59.967923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:08:59.968798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:08:59.969713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application result.read() Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:08:59.970623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [parameters: {'id': '639235218cc64687815db4b61f1a976d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:08:59.972009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 21:08:59.972809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:08:59.976590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 240/478] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 21:08:59 2022] POST /identity/v3/roles => generated 144 bytes in 318 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:08:59.981844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe4fec-a615-401d-a605-1b95ce175318 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:00.049585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:00.140065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe4fec-a615-401d-a605-1b95ce175318 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:00.190074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1f6a8-6ffd-4649-9e50-47febef29674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:00.190721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1f6a8-6ffd-4649-9e50-47febef29674 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:00.190984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1f6a8-6ffd-4649-9e50-47febef29674 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:00.191510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1f6a8-6ffd-4649-9e50-47febef29674 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:00.207002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1f6a8-6ffd-4649-9e50-47febef29674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-70d1f6a8-6ffd-4649-9e50-47febef29674 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:00.212038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:00.214317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:00.215648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 239/479] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:08:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:00.222228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:00.354850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605c5ee-ce55-4403-a7cc-1d2a74cfdbb2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:00.409113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf505-705a-4149-b574-2e8a4285f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:00.409782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf505-705a-4149-b574-2e8a4285f01b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:00.410036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf505-705a-4149-b574-2e8a4285f01b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:00.410314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf505-705a-4149-b574-2e8a4285f01b None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:00.410989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf505-705a-4149-b574-2e8a4285f01b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:00.411351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf505-705a-4149-b574-2e8a4285f01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:00.412668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf505-705a-4149-b574-2e8a4285f01b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:00.425422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 241/480] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:00.593899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5559-8544-426b-9de5-75ed43cd55ff None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:00.594291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5559-8544-426b-9de5-75ed43cd55ff None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:00.594476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5559-8544-426b-9de5-75ed43cd55ff None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:00.597436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 240/481] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:00.607431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05720a5-9400-4b2b-9c6a-23585e99bb0b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:00.607745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05720a5-9400-4b2b-9c6a-23585e99bb0b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:00.608223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05720a5-9400-4b2b-9c6a-23585e99bb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:00.638409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e05720a5-9400-4b2b-9c6a-23585e99bb0b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:00.640514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e05720a5-9400-4b2b-9c6a-23585e99bb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:00.660371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:00.745435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 242/482] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:01.062647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee5559-8544-426b-9de5-75ed43cd55ff None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:01.175654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee5559-8544-426b-9de5-75ed43cd55ff None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:01.178185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:01.215099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1e6a5-8b67-4aef-b682-3c5e2dcb7039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:01.215719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e6a5-8b67-4aef-b682-3c5e2dcb7039 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:01.216010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e6a5-8b67-4aef-b682-3c5e2dcb7039 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:01.216381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e6a5-8b67-4aef-b682-3c5e2dcb7039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:01.230839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1e6a5-8b67-4aef-b682-3c5e2dcb7039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-cdf1e6a5-8b67-4aef-b682-3c5e2dcb7039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:01.235822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:01.236762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:01.237681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:01.241184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 241/483] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:01.246313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05720a5-9400-4b2b-9c6a-23585e99bb0b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:01.334255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96088676-639b-4449-bf05-a7be3b400c91 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:01.334650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96088676-639b-4449-bf05-a7be3b400c91 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:01.334866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96088676-639b-4449-bf05-a7be3b400c91 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:01.336287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 242/484] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:01.360748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d0e18-c192-4439-be50-cffc9b86a8f4 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:01.361097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d0e18-c192-4439-be50-cffc9b86a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:01.361362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d0e18-c192-4439-be50-cffc9b86a8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:01.397481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1d5d0e18-c192-4439-be50-cffc9b86a8f4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:01.399380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1d5d0e18-c192-4439-be50-cffc9b86a8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:01.502727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05720a5-9400-4b2b-9c6a-23585e99bb0b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:01.528799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 243/485] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:09:01.568623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:01.569276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:01.569561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:01.569836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:01.570584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:01.570914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:01.572378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:01.586193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 243/486] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:01.591956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d0e18-c192-4439-be50-cffc9b86a8f4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:01.702953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:01.716675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d0e18-c192-4439-be50-cffc9b86a8f4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:01.760804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:01.761443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:01.761725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:01.761997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:01.778234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:01.779729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:01.806037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:01.806978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:01.807783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:01.807783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:01.807783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:01.807783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 244/487] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:01.813765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:01.829620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:01.852849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.021559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839eaa9-d93f-4848-9c57-d7288453d94c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.052471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cef42-bbb9-42b7-9653-838e386fecd8 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.061880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091bac-ad5a-4903-81e5-6aac2030f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.063042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091bac-ad5a-4903-81e5-6aac2030f990 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.063317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091bac-ad5a-4903-81e5-6aac2030f990 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.063595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091bac-ad5a-4903-81e5-6aac2030f990 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.064270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091bac-ad5a-4903-81e5-6aac2030f990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:02.064676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091bac-ad5a-4903-81e5-6aac2030f990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:02.066399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091bac-ad5a-4903-81e5-6aac2030f990 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:02.081180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 244/488] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:02.082874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29dfcd-c8e5-424a-979f-6839989b50e3 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.083162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29dfcd-c8e5-424a-979f-6839989b50e3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.083437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29dfcd-c8e5-424a-979f-6839989b50e3 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.084680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 245/489] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:02.085968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce9bd-a89c-41c5-a39c-b771b5fb1ca5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.086396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce9bd-a89c-41c5-a39c-b771b5fb1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.087072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce9bd-a89c-41c5-a39c-b771b5fb1ca5 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.088672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 246/490] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:02.089576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dce9bd-a89c-41c5-a39c-b771b5fb1ca5 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.108722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983bf4a-8201-4a5a-8960-77999659ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.109404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983bf4a-8201-4a5a-8960-77999659ef76 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.109844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983bf4a-8201-4a5a-8960-77999659ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.110277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983bf4a-8201-4a5a-8960-77999659ef76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.122114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983bf4a-8201-4a5a-8960-77999659ef76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-8983bf4a-8201-4a5a-8960-77999659ef76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:02.128134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:02.129315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:02.130094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:02.130670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 245/491] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:02.135946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aebc7-621f-4f9f-a898-33c1b06eb984 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.135946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aebc7-621f-4f9f-a898-33c1b06eb984 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.135946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aebc7-621f-4f9f-a898-33c1b06eb984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.148051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:02.154565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-db5aebc7-621f-4f9f-a898-33c1b06eb984 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:02.162222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-db5aebc7-621f-4f9f-a898-33c1b06eb984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:02.178510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:02.223384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dce9bd-a89c-41c5-a39c-b771b5fb1ca5 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.251158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 246/492] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:02.252770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e973d-e772-49d8-9ac7-ae00f8dd7b2b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.253092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e973d-e772-49d8-9ac7-ae00f8dd7b2b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.253346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e973d-e772-49d8-9ac7-ae00f8dd7b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.273403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.273988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-373e973d-e772-49d8-9ac7-ae00f8dd7b2b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:02.274976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-373e973d-e772-49d8-9ac7-ae00f8dd7b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:02.275206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.275708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.276192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.286270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:02.288450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:02.304795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:02.305857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:02.306763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:02.309757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 247/493] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:09:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:02.310925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.376800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 247/494] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:02.378267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e973d-e772-49d8-9ac7-ae00f8dd7b2b None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.471626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29ca2c-e175-4625-8ca9-ae2aa73eded1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.510740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:02.520960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:02.533666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.533666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.533666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.533666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.534033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:02.534296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:02.535557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:02.547275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 248/495] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:02.558121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.577558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e973d-e772-49d8-9ac7-ae00f8dd7b2b None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.632339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.632994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.633302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.633575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.634315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:02.634621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:02.636063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:02.677854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 248/496] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:09:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:02.678718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.722292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c2fa0-142a-4624-89a2-457219a9b4d5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.764308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.764948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.765259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.765528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.778703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:02.780631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:02.793154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a520b1e-a487-43f9-83cb-968dce2d237e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:02.797155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:02.798046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:02.804596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:02.804596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:02.804596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:02.804596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 249/497] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:02.804596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.824883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:02.839564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.840102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.840376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.840640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.853997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:02.859035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:02.860113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:02.860892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:02.861554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:02.861624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 249/498] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:02.861877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:02.932334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cebb3-c691-49e1-bf13-b0b6fec2c86f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:02.972278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:02.972894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:02.973216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:02.973521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:02.975933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885354-3aab-4b2b-b535-db3d977cb0f3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.024267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.025293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.025735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.026008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.038480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:03.043378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:03.044239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:03.045147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 250/499] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:03.045808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.051329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.052787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.093559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.093750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.148668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0f7f-1a2f-4288-94ca-ceb6f064ffc2 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.153878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 250/500] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:03.154734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.186729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a58b7-14ec-4ba9-85e2-cdf99fc917f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.187374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a58b7-14ec-4ba9-85e2-cdf99fc917f5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.187724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a58b7-14ec-4ba9-85e2-cdf99fc917f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.188000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a58b7-14ec-4ba9-85e2-cdf99fc917f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.188675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a58b7-14ec-4ba9-85e2-cdf99fc917f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:03.188978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a58b7-14ec-4ba9-85e2-cdf99fc917f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.190931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a58b7-14ec-4ba9-85e2-cdf99fc917f5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.203006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 251/501] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:03.204386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb22c5-cdfb-4899-9e68-0c7ee669b791 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.204658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb22c5-cdfb-4899-9e68-0c7ee669b791 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.205083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb22c5-cdfb-4899-9e68-0c7ee669b791 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.207036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 252/502] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:03.207579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb22c5-cdfb-4899-9e68-0c7ee669b791 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.260526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb18904-660e-4e22-85cd-8a53b8cb19ea None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.296070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.296782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.296990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.297215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.297891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:03.298200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.299995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.308988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 251/503] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:03.311402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.316760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.326658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb22c5-cdfb-4899-9e68-0c7ee669b791 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.329322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.362518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.363124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.363403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.363706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.364382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:03.364692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.366190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.374544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 253/504] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:03.375375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.422035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab8295-80cf-4d39-bc97-b16844d9400c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.458687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6ffa-416b-4861-9e15-6aa491a270e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.459434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6ffa-416b-4861-9e15-6aa491a270e2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.459711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6ffa-416b-4861-9e15-6aa491a270e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.459980 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6ffa-416b-4861-9e15-6aa491a270e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.471091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6ffa-416b-4861-9e15-6aa491a270e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.472600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6ffa-416b-4861-9e15-6aa491a270e2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.480873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984a2a4-c34a-40fc-8dfe-65b31e3a385d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-0fdb6ffa-416b-4861-9e15-6aa491a270e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:03.488076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:03.489046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:03.489911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:03.489911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:03.489911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:03.489911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 252/505] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:03.490568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5a79-c188-4b00-8efe-e53ebad592e3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.490780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5a79-c188-4b00-8efe-e53ebad592e3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.491040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5a79-c188-4b00-8efe-e53ebad592e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.509908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-c2ef5a79-c188-4b00-8efe-e53ebad592e3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:03.511107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c2ef5a79-c188-4b00-8efe-e53ebad592e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:03.526207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.526842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.527128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.527394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.535299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.536760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:03.550673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:03.551696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 254/506] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:03.552942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.567818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.584102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.587026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 253/507] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:03.587865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef5a79-c188-4b00-8efe-e53ebad592e3 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.679413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80eaa1-933d-47d3-896d-2d1fd0e7c70d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.703176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef5a79-c188-4b00-8efe-e53ebad592e3 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.717404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.718045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.718333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.718609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.729744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.731269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.746005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.746670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.746978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.747249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:03.748503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:03.749626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:03.750479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:03.750479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:03.750479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:03.750479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 255/508] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:03.750697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.761867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.763228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:03.779514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:03.780521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:03.781483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:03.781483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:03.781483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:03.781483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 254/509] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:03.781483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.822200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.853251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:03.876945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb089-a2dd-4e11-8cbc-c3788b7a2364 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.903807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252dc1-8bd3-4baf-82ab-e1ad804e49f2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:03.913622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.914075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.914355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.914646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.915291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:03.915596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.917003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.930573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 256/510] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:03.931265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:03.945428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:03.946040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:03.946322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:03.946594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:03.947350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:03.947684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:03.949201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:03.987844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 255/511] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:03.989238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.044856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576fdbd-3930-4e82-9cfc-6f85549712a5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.080320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.080847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.081148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.081421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.082066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:04.082367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.083729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.087792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.090248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.094615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a082ec-489a-489a-8065-84418df57ef5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.096167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 257/512] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:04.097000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.134477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.135121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.135400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.135673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.136329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:04.136751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.138183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.150844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 256/513] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:04.151772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.213393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33281bae-c7f6-4071-ba40-85b32abb0f76 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.248760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.251512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.251512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.251512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.260875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31215530-c2bc-4025-b680-05bb9e6fda75 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.262098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.263658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:04.279952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:04.281879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:04.284038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:04.284038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:04.284038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:04.284038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 258/514] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:04.284038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.304679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.305396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.305640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.305912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.313821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.315360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:04.328427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:04.329552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 257/515] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:04.330931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.349301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.361457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.434974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd3f50-8be6-46ca-9afc-fbb85b959f71 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.436103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0d71-935a-4d05-bf6a-dca42f0c1c0a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.472758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.473399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.473681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.474007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.474472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.475110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.475394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.475668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.483390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.484849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:04.497288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:04.499123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 258/516] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:04.500970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.556564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.558083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.580604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.607469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e934d7c-3ae8-44b6-961c-589d8dfbfb38 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.610075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.643224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.643877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.644181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.644447 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.652372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.653840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.662093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 259/517] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:04.662927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:04.664962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:04.665875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:04.666748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 259/518] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:04.667383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.773932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ed41-3c8d-4c94-9cda-fec55ff8da63 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.776101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23000d0-af35-4b13-b4fb-5b3db5bdbf59 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.808786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.809428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.809705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.809979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.810715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:04.811017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.812153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.812454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.812760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.813034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.813325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.813963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:04.814795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.814930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.816784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.834459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 260/519] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:04.834459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.863048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 260/520] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:04.863048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:04.863758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:04.937416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07ed37-a8dd-47b8-a01e-a6e8fe8a6861 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.945070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7069-ae79-4353-89f7-48f16d842a53 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:04.972664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.973300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.973663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.973940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.974670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:04.974977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:04.976422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:04.985878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:04.987045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:04.987321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:04.987583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:04.994841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 261/521] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:04.995673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.003970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.005455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:05.020125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:05.021355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:05.022284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:05.022284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:05.022284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:05.022284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 261/522] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:05.022284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.069412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:05.075895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:05.107913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4a46-230e-4cc1-9a68-f2755e409a8d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:05.137644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77a58a-0b90-4948-971d-eb830bce07a1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:05.146542 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:05.147165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:05.147446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:05.147714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:05.148464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:05.148926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.150426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:05.170583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 262/523] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 29 21:09:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:05.171684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.176438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:05.177102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:05.177392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:05.177672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:05.178344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.179830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:05.280818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e248f-16cd-41a3-82ee-2a000671b6a0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:05.306574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:05.326280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:05.326280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:05.326280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:05.326280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:05.326775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=5546fd3a7c324d4583817707572b1245) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:05.326775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.326775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:05.326775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 263/524] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:05 2022] GET /identity/v3/role_assignments?user.id=5546fd3a7c324d4583817707572b1245&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:05.326775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.438116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e385-b531-4741-8bcd-c9ac17583ded None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:05.478080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:05.478634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:05.478913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:05.479181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:05.482470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 262/525] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:09:05 2022] POST /identity/v3/users => generated 247 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:05.483354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.565906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:05.581488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.583657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:05.627106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33455b7b-e7d2-4ec1-ad20-4febab9c8cd0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:05.628893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:05.677264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:05.677886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:05.678165 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:05.678434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:05.679077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:05.679677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.680816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:05.695979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 263/526] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:05.696955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.732528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 264/527] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:05.733429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.844826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc556-3b82-4b3a-9ea3-5f4052d6f3a6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:05.851237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:05.863225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa8c5-3aec-4c2c-ae12-29ece1929ae5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:05.893408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:05.895313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:05.895854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:05.896199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:05.915850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:05.916655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:05.917213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:05.917588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:05.926936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.928815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:05.934462 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:05.944847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:05.949425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 265/528] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:05.950314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:05.977904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:05.979401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.075749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4c463-30c3-4992-824c-f906feb8220e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.095254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 264/529] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:06.096263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.119109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.119884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.120234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.120583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.132543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.134214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:06.150870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:06.151828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:06.152661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:06.152661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:06.152661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:06.156708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 266/530] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:06.157620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.160819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:06.168124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:06.215020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f59afc-778c-4dc0-91d4-536e3335ab15 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.254502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.255127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.255409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.255685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.256480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:06.256795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.258436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.272816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 265/531] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:06.273705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.276220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7520f9-2ebc-4407-9b0c-d306c115c9bd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.315809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.316772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.317235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.317571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.334133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.335743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:06.356507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:06.358803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:06.361559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:06.361559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:06.361559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:06.361559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 267/532] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:06.369133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.419945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561b093-aed6-4fac-a900-9f4508f054ec None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.431208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:06.454502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:06.468967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.470033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.470340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.470625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.471563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:06.471869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.474821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.485579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37158439-e5d8-46d9-83e5-6109f9173eff None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.494425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 266/533] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:06.495364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.531475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.532438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.532727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.533123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.533964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=01d2e6366b3c488c8b893584f59a98db) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:06.534376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.535909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.542488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 268/534] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/role_assignments?user.id=01d2e6366b3c488c8b893584f59a98db&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:06.543325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.622500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b9fb-4c95-443a-8a34-3bd50e93f1a1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.663870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25b150-5ede-4c0f-be04-390a3f68ac27 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.664230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.664503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.664753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.665022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.665829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:06.666133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.667654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.686750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 267/535] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:06.687434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:06.689742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.704502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.705231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.705514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.705788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.714488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.716049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:06.731472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:06.732515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:06.733579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:06.741093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 269/536] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:06.742090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.752715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:06.863674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c99f4-fe9c-4dfc-985a-2fbe2ab91d20 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.897612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafb630-e782-4dc9-8184-5ca2ca5186ff None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:06.902042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.902731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.903011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.903331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.904129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:06.904437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.905911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:06.927809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 270/537] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:06.934505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:06.981952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:06.982625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:06.982992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:06.983270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:06.992056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:06.997442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:07.002412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:07.028967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:07.029886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:07.030700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:07.037350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 268/538] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:07.038302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:07.088165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f684-bc91-4047-93ea-005e82a8f92a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:07.154923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:07.155604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:07.155883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:07.156150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:07.156898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=b56b3fafca1e47f88482bf25a77a0fea) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:07.157232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:07.159259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:07.172637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 271/539] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:06 2022] GET /identity/v3/role_assignments?user.id=b56b3fafca1e47f88482bf25a77a0fea&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:07.235767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5412a69-645c-4832-8ce2-b6eccf7080e2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:07.237286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:07.287526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6b171-20ae-4d26-9f8c-b277346f202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:07.288218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6b171-20ae-4d26-9f8c-b277346f202d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:07.288504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6b171-20ae-4d26-9f8c-b277346f202d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:07.288778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6b171-20ae-4d26-9f8c-b277346f202d None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:07.289507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6b171-20ae-4d26-9f8c-b277346f202d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:07.289811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6b171-20ae-4d26-9f8c-b277346f202d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:07.291528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6b171-20ae-4d26-9f8c-b277346f202d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:07.306489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 269/540] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:07.316592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:07.462899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe9ef-4a2f-4b66-9470-59ec8576808a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:07.464952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:07.508159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ba7a9-2822-4604-a2b4-795b778f6e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:07.508796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba7a9-2822-4604-a2b4-795b778f6e49 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:07.509030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba7a9-2822-4604-a2b4-795b778f6e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:07.509319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba7a9-2822-4604-a2b4-795b778f6e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:07.510064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba7a9-2822-4604-a2b4-795b778f6e49 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=e72f7d1f9961446c8938e3f161fb03f7) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:07.510374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba7a9-2822-4604-a2b4-795b778f6e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:07.511890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba7a9-2822-4604-a2b4-795b778f6e49 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:07.518938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 272/541] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:07 2022] GET /identity/v3/role_assignments?user.id=e72f7d1f9961446c8938e3f161fb03f7&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:07.594707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5bc7-3fdb-4e26-9c6b-a0b50ea26bf3 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:07.595221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5bc7-3fdb-4e26-9c6b-a0b50ea26bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:07.595335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5bc7-3fdb-4e26-9c6b-a0b50ea26bf3 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:07.596874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 270/542] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:07.602814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4319cb-5a66-49a6-a9c6-439011e6c3f3 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:07.603102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4319cb-5a66-49a6-a9c6-439011e6c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:07.603368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4319cb-5a66-49a6-a9c6-439011e6c3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:07.630245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ab4319cb-5a66-49a6-a9c6-439011e6c3f3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:07.631491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ab4319cb-5a66-49a6-a9c6-439011e6c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:07.730989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 273/543] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:09:07.967275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a774e48-c8c9-4b91-a6be-c3ffab477ae9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:07.967528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a774e48-c8c9-4b91-a6be-c3ffab477ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:07.967972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a774e48-c8c9-4b91-a6be-c3ffab477ae9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:07.969662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 271/544] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:07.976617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef3086-730a-4bcf-9977-75922217ef0e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:07.977103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef3086-730a-4bcf-9977-75922217ef0e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:07.977588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef3086-730a-4bcf-9977-75922217ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:08.013749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-d9ef3086-730a-4bcf-9977-75922217ef0e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:08.015777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d9ef3086-730a-4bcf-9977-75922217ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:08.187750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 274/545] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:08.322099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a774e48-c8c9-4b91-a6be-c3ffab477ae9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:08.474065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a774e48-c8c9-4b91-a6be-c3ffab477ae9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:08.523093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:08.523747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:08.524028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:08.524294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:08.540497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:08.545638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:08.547166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:08.549615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 272/546] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:08.555615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef3086-730a-4bcf-9977-75922217ef0e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:08.622674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:08.747403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:08.800960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:08.805653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef3086-730a-4bcf-9977-75922217ef0e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:08.893212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:08.893836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:08.894113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:08.894384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:08.895063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:08.895368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:08.897462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:08.912907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 275/547] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:08.929630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:08.965358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab343-e29c-43d5-a6b0-914d491cc6cd None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.023798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adc28e-b81d-4c34-93ec-3426bbee534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.024357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc28e-b81d-4c34-93ec-3426bbee534a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.024638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc28e-b81d-4c34-93ec-3426bbee534a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.024913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc28e-b81d-4c34-93ec-3426bbee534a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.047162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adc28e-b81d-4c34-93ec-3426bbee534a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-57adc28e-b81d-4c34-93ec-3426bbee534a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:09.052181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:09.054023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:09.055196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 273/548] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:09.056317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b5259-22e0-4715-ad6e-315527dc09b7 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.056609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b5259-22e0-4715-ad6e-315527dc09b7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.056884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b5259-22e0-4715-ad6e-315527dc09b7 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.058198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 274/549] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:09.059456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b5259-22e0-4715-ad6e-315527dc09b7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:09.110681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:09.133097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0303a6-d3db-4c00-8f27-7e09acaf7613 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.170474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:09.181785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbf1be-fc55-4a72-8339-9fc522a9cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.183148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbf1be-fc55-4a72-8339-9fc522a9cf19 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.184280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbf1be-fc55-4a72-8339-9fc522a9cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.185039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbf1be-fc55-4a72-8339-9fc522a9cf19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.195528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b5259-22e0-4715-ad6e-315527dc09b7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.200565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbf1be-fc55-4a72-8339-9fc522a9cf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:09.202385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbf1be-fc55-4a72-8339-9fc522a9cf19 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-9dcbf1be-fc55-4a72-8339-9fc522a9cf19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:09.224030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:09.224988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:09.226201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:09.226201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:09.226201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:09.232012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 276/550] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:09.232012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d439d0-d2f7-4d34-91c3-bf1232ef012e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.232012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d439d0-d2f7-4d34-91c3-bf1232ef012e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.232012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d439d0-d2f7-4d34-91c3-bf1232ef012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.247321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.248529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.249118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.249589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.250471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:09.251017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:09.254083 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:09.258101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e3d439d0-d2f7-4d34-91c3-bf1232ef012e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:09.259314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e3d439d0-d2f7-4d34-91c3-bf1232ef012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:09.265141 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 275/551] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:09.266371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:09.365171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 277/552] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:09.365171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d439d0-d2f7-4d34-91c3-bf1232ef012e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:09.415795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae196-c165-4460-9553-e792c8a0981e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.482504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.483233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.483683 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.483965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.485056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:09.485386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:09.488580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:09.520525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 276/553] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:09.527849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:09.534030 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:09.541323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:09.615454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d439d0-d2f7-4d34-91c3-bf1232ef012e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.691365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.692030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.694176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.694463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.707114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:09.709006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:09.723484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b37f-d039-4504-86a0-5176973f8e92 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:09.726013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:09.726906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:09.727799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:09.727799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:09.727799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:09.729605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 278/554] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:09.730683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:09.764974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.765912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.766403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.766754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.778076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:09.779768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:09.795181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:09.796368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 277/555] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:09.797678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:09.876565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e185db-ad10-426d-9d24-6b6cb65b695a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.885001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:09.904699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:09.918776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.920698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.920982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.921291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.929945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a1385-69eb-4dff-8393-4534d9b57d08 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:09.940183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:09.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:09.949019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:09.950320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 279/556] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:09.951629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:09.972987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86243f3-bd57-4320-9f00-f103a54ab042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:09.973736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86243f3-bd57-4320-9f00-f103a54ab042 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.974018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86243f3-bd57-4320-9f00-f103a54ab042 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.974307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86243f3-bd57-4320-9f00-f103a54ab042 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.974927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86243f3-bd57-4320-9f00-f103a54ab042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:09.975226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86243f3-bd57-4320-9f00-f103a54ab042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:09.976641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86243f3-bd57-4320-9f00-f103a54ab042 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:09.994924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 278/557] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:09.994924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0c650-7711-43f6-b928-590c277041fe None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:09.994924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0c650-7711-43f6-b928-590c277041fe None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:09.994924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0c650-7711-43f6-b928-590c277041fe None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:09.994924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 279/558] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:09.994924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0c650-7711-43f6-b928-590c277041fe None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.091013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d2589-6897-459f-b8e1-7ef306bff2a5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.112760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0c650-7711-43f6-b928-590c277041fe None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.132215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.132845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.133292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.133685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.134559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:10.134988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.136638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.139051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:10.150759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5df2f-9862-4305-91c2-758294f4c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.151371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5df2f-9862-4305-91c2-758294f4c0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.151662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5df2f-9862-4305-91c2-758294f4c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.157209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5df2f-9862-4305-91c2-758294f4c0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.157209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5df2f-9862-4305-91c2-758294f4c0b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:10.157209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5df2f-9862-4305-91c2-758294f4c0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.157209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5df2f-9862-4305-91c2-758294f4c0b4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.157702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 280/559] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:10.157702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.169382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 280/560] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:10.169382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ab6ae-7063-4286-8170-3ea75c409781 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.169382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ab6ae-7063-4286-8170-3ea75c409781 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.169382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ab6ae-7063-4286-8170-3ea75c409781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.185121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-da2ab6ae-7063-4286-8170-3ea75c409781 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:10.186366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-da2ab6ae-7063-4286-8170-3ea75c409781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:10.206081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:10.258891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 281/561] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:10.260169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd0c4-9cde-4827-902f-49773bb8d4b9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.260533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd0c4-9cde-4827-902f-49773bb8d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.260816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd0c4-9cde-4827-902f-49773bb8d4b9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.262257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 282/562] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:10.262810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd0c4-9cde-4827-902f-49773bb8d4b9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.272367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b128c-2f68-4d12-a196-7d57fcd4c4fd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.310570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.311618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.312098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.312586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.321917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.324649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:10.338188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:10.339225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 281/563] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:10.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.394117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd0c4-9cde-4827-902f-49773bb8d4b9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.413950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:10.434124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0178a5c-df01-4e8c-bd24-6d274657ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.434864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0178a5c-df01-4e8c-bd24-6d274657ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.435068 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0178a5c-df01-4e8c-bd24-6d274657ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.435561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0178a5c-df01-4e8c-bd24-6d274657ecd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.448517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0178a5c-df01-4e8c-bd24-6d274657ecd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.450075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0178a5c-df01-4e8c-bd24-6d274657ecd9 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-d0178a5c-df01-4e8c-bd24-6d274657ecd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:10.466470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:10.467622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:10.468784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:10.468784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:10.468784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:10.469807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:10.471871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 283/564] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:10.473543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8af0-8d4d-46b7-89f5-d87cd3f0a26a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.473836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8af0-8d4d-46b7-89f5-d87cd3f0a26a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.474014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8af0-8d4d-46b7-89f5-d87cd3f0a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.479095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deda09-ff50-40c5-9bf0-afb30b28760d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.493616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-fddf8af0-8d4d-46b7-89f5-d87cd3f0a26a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:10.494942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fddf8af0-8d4d-46b7-89f5-d87cd3f0a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:10.521130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.521130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.521130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.521130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.534334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.535987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:10.551184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:10.553192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:10.554650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:10.554650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:10.554650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:10.554650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 282/565] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:10.554650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.584146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 284/566] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:10.585157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8af0-8d4d-46b7-89f5-d87cd3f0a26a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.661625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fa73-dc48-4c4f-88c9-f11e60f47a7e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.698781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.699389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.699666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.699941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.700671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:10.700979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.702421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.702917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:10.707926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8af0-8d4d-46b7-89f5-d87cd3f0a26a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.723057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 283/567] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:10.723904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.738859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:10.752905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.753564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.753858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.754117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.754835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:10.755142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.756519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.770869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 285/568] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:10.771709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.861112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57e6ad-8441-4157-acba-c2dbffbe3121 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.898755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.899634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.899919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.900329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.901387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bd5c6-707b-4320-ac1e-ead97fc0f889 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:10.914331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:10.919153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:10.921347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 284/569] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:10.923523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.943727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:10.944336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:10.944612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:10.944882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:10.945564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:10.945861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:10.947253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:10.960367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 286/570] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:10.961012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:10.981396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:10.999499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.036490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc32bb-8db4-4047-af45-2b01ec18341c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.070948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181b62e-3855-4081-a46e-85c7fcfdeec3 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.076386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.076999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.077335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.077604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.113365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.113996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.114299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.114571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.122089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.123650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:11.135351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 287/571] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:11.137280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.157145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.159264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.223841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.233642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.246926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddef749-eca5-43c1-8096-c65a8e87509e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.268203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 285/572] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:11.269438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.286166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.286791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.287068 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.287338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.298082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:11.303359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:11.304284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:11.305131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 288/573] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:11.305822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.375646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d6d27-61a0-4968-971e-9f30a1f4b565 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.411812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b533b-9a11-4272-8587-598df2e61037 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.413314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.413934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.414216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.414488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.415167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:11.415479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.416955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.426543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 286/574] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:11.427411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.463546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.466598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.467535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.467970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.468389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.479571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.480930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.483192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:11.494695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:11.495918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:11.496845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 289/575] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:11.497448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.548068 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee10f8-5b3c-48a3-8a98-afadfd7f9755 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.586795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3003f9-010f-491f-8243-e488961236bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.587401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3003f9-010f-491f-8243-e488961236bb None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.587678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3003f9-010f-491f-8243-e488961236bb None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.587949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3003f9-010f-491f-8243-e488961236bb None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.588638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3003f9-010f-491f-8243-e488961236bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:11.588946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3003f9-010f-491f-8243-e488961236bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.590396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3003f9-010f-491f-8243-e488961236bb None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.602626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 287/576] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:11.603733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3003f9-010f-491f-8243-e488961236bb None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.617790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf9e6-05ae-48c3-a365-eda268fd9504 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.655600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.656219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.656496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.656766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.667941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.669435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:11.683608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:11.684601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:11.685511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:11.685511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:11.685511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:11.685511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 290/577] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:11.685511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.703582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.712816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3003f9-010f-491f-8243-e488961236bb None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.742493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.750520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.751209 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.751482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.751751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.752418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:11.752721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.754142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.762498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 288/578] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:11.763324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.809663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492581d-f2b8-4cf6-ac2d-db3952d23642 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.846837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.847503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.847783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.848055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.860859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.862486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.880470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35019a-7f90-459c-a7c9-b832e720f652 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:11.880680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:11.882172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:11.883040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:11.883040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:11.883040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:11.883040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 291/579] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:11.883541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.921937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:11.922612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:11.922890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:11.923161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:11.923920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:11.924225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:11.925815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:11.943250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 289/580] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:11.943976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:11.958792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:11.996825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4ec5-2c1e-4e13-a558-d8ebfb2e2fd4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:11.998327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.031941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.032641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.032924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.033225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/5546fd3a7c324d4583817707572b1245/roles/290a4533dad74846ae9cadca3f9000e5` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.044137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9197-5e5f-4a7f-8aa0-fce73e11e7de None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.048270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=5546fd3a7c324d4583817707572b1245, role_id=290a4533dad74846ae9cadca3f9000e5)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.049766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.079155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.080364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.080638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.080905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.081577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:12.081884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.083244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.094410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 290/581] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:12.095210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.144059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 292/582] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:11 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/5546fd3a7c324d4583817707572b1245/roles/290a4533dad74846ae9cadca3f9000e5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:12.144941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.167532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.204000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d15b-b991-4a8f-b6f7-e1a62fd09d4e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.245637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.246626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.246964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.247447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.259831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.261413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.273142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeb33b-1997-4dc5-bc75-27c5c4ba6fe2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:12.277468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:12.278435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:12.279348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:12.279348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:12.279348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:12.279348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 291/583] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:12.280005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.321972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.322672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.322953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.323226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.323913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:12.324215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.325735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.338615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 293/584] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:12.343274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.358253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.409390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77e0a-ce31-4df3-8a61-e5d0acade84c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.435441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.449949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.450702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.450890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.451118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.453931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797355f3-53b9-4068-ac04-d78383a813d6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.463085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.464590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:12.481384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:12.482506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:12.483635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:12.483635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:12.483635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:12.487793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 292/585] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:12.488666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.495459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.496179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.496473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.496731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.504194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.505606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:12.517579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:12.518649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 294/586] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:12.519523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.609184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.617958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639967e-3b9f-4c5b-ba01-3b9499697494 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.646085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6a004-21e5-4ce4-b0e0-4c85326f2fc3 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.657210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.658412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.658693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.658964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.659609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:12.659914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.661383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.673544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 293/587] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:12.674443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.694546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.695543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.696012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.696496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.705803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.707563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:12.720787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:12.721779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:09:12.723078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:12.723692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.727103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 295/588] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:12.732731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.800671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54c19-4aeb-43b7-b5cc-65d45f9d6eae None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.841991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.842700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.843046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.843323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.843966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:12.844271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.845687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.847434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ae29-140e-4980-b1d7-03fd689e598c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:12.858185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 294/589] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:12.863521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.889124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.897788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:12.898958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:12.898958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:12.898958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:12.899635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:12.899938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:12.901713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:12.915302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 296/590] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:12.916795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:12.985014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:12.990973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fdee6-679c-4af9-b9e0-1ea999b9a191 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.030689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.031478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.031856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.032227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.036109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11235c50-8308-4526-a63b-c7b4f58abdbc None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.039897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.041476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:13.053957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:13.055137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:09:13.056311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:13.058023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 295/591] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:13.058782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.077515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.078126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.078403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.078669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.079393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:13.079745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.081180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.104382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 297/592] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 21:09:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:13.104382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.162726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:13.190771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81ea1-b64b-44c8-937e-55f1c0a55b87 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.223744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed10a9-c61f-4516-95ed-6331366ee634 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.239151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.239803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.240085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.240381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.250012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.252210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:13.265681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:13.266919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 296/593] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:13.268157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.276894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.277563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.277839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.278106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.278889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=afacbc4812494825a43083cbba245e4f) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:13.279191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.280769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.297095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 298/594] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/role_assignments?user.id=afacbc4812494825a43083cbba245e4f&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:13.297095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.297393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:13.426787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05108b31-252e-46d1-bcde-54da1268b610 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.448931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed7d7b-14ad-4079-b2cb-8a1ca345cc42 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.476233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:13.481961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.483071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.483565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.484010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.484895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:13.485395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.487557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.510208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.511318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.511595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.511909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.518507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 297/595] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:13.520327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.524075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.526473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:13.543777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:13.545652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:13.547339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:13.547339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:13.547339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:13.553092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 299/596] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:13.553092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.625958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:13.654225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec073fef-915c-441b-b039-d988d2313e60 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.677418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fddfb-a80f-4865-aa87-505411b68d1a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.697428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.698085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.698364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.698636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.699370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:13.699677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.701270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.714912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 298/597] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:13.715774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.716020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.716669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.716952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.717306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.730404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.731867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:13.752275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:13.755407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:13.758806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:13.758806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:13.758806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:13.758806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 300/598] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:13.758806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.781683 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:13.861752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fb98-118e-4cb7-a3a2-17b7dbf33b28 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.888019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9fc2e-c09a-4db7-867b-3a2c7911c974 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:13.911173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.912200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.913008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.913483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.915983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:13.916513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.918152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:13.920477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:13.949284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 299/599] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:13.949284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:13.956972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:13.961881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:13.962266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:13.962549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/01d2e6366b3c488c8b893584f59a98db/roles/290a4533dad74846ae9cadca3f9000e5` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:13.982706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=01d2e6366b3c488c8b893584f59a98db, role_id=290a4533dad74846ae9cadca3f9000e5)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:13.983755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:14.096151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb4cad-c74a-47f3-82b8-fba706c0ef7e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:14.101333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 301/600] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:13 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/01d2e6366b3c488c8b893584f59a98db/roles/290a4533dad74846ae9cadca3f9000e5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:14.102365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:14.189043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:14.189930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:14.190465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:14.190911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:14.192015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:14.192477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:14.194173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:14.205888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:14.225549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 300/601] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:14.232642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:14.263506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6029-3fb8-4208-84bf-1fc673ad7a1a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:14.356966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:14.363357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:14.365126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:14.365126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:14.365126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:14.378012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:14.380822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:14.403180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:14.404128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:14.404991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:14.407518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 302/602] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:14.416391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:14.461389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709adce-0abf-47d4-a236-bbb4bbcf0557 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:14.517791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6339f-15cb-43bb-bff9-366f0f66f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:14.518871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6339f-15cb-43bb-bff9-366f0f66f553 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:14.519169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6339f-15cb-43bb-bff9-366f0f66f553 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:14.519446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6339f-15cb-43bb-bff9-366f0f66f553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:14.528057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6339f-15cb-43bb-bff9-366f0f66f553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:14.530189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6339f-15cb-43bb-bff9-366f0f66f553 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-daf6339f-15cb-43bb-bff9-366f0f66f553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:14.548549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:14.549544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:14.550402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:14.555916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 301/603] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:14.558126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346c8de-63c7-4712-9d15-7f1656b06399 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:14.558588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346c8de-63c7-4712-9d15-7f1656b06399 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:14.559043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346c8de-63c7-4712-9d15-7f1656b06399 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:14.569572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 302/604] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:14.573710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df373bb-a337-41d7-863e-3f2712a31c27 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:14.574156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df373bb-a337-41d7-863e-3f2712a31c27 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:14.574595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df373bb-a337-41d7-863e-3f2712a31c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:14.605208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8df373bb-a337-41d7-863e-3f2712a31c27 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:14.607181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8df373bb-a337-41d7-863e-3f2712a31c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:14.613579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69932-9a2d-4a2f-ae62-ba2c076a6207 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:14.657035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:14.668721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:14.670087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:14.670536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:14.671408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:14.672610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:14.673085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:14.676077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:14.695031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 303/605] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:14.696138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:14.704620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 303/606] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:09:14.705928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df373bb-a337-41d7-863e-3f2712a31c27 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:14.795975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:14.877923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df373bb-a337-41d7-863e-3f2712a31c27 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:14.924242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f25399-8ffb-4e7f-9ab7-84ca03b35949 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:14.953942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:14.954765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:14.955047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:14.955383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/b56b3fafca1e47f88482bf25a77a0fea/roles/290a4533dad74846ae9cadca3f9000e5` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:14.988646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=b56b3fafca1e47f88482bf25a77a0fea, role_id=290a4533dad74846ae9cadca3f9000e5)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:14.990668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:15.011570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:15.012386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:15.012872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:15.013180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:15.013882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:15.014378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:15.015948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:15.029747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 304/607] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:15.038520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:15.113367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:15.141424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 304/608] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:14 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/b56b3fafca1e47f88482bf25a77a0fea/roles/290a4533dad74846ae9cadca3f9000e5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:15.142889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:15.222964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51b6f-f64b-422d-a02e-6e61b40363da None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:15.276784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:15.285759 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f990d-e3cc-4da7-ae1e-52c6e9a2f735 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:15.304553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:15.305415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:15.305764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:15.306108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/e72f7d1f9961446c8938e3f161fb03f7/roles/290a4533dad74846ae9cadca3f9000e5` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:15.331277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:15.332334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:15.332822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:15.333334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:15.345602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=e72f7d1f9961446c8938e3f161fb03f7, role_id=290a4533dad74846ae9cadca3f9000e5)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:15.348868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:15.349013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:15.354917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:15.355916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:15.356775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:15.359957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 305/609] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:15.367633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:15.444491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 305/610] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:15 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/e72f7d1f9961446c8938e3f161fb03f7/roles/290a4533dad74846ae9cadca3f9000e5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:15.508864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28819-d796-4207-acc0-c6219787808a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:15.567782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:15.569229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:15.569919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:15.570669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:15.572086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:15.572871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:15.575740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:15.591052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 306/611] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:15.599426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:15.762847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:15.767997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72626a-ec8d-4bd9-ac94-9436e85632c6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:15.812129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38971e3c-ecec-4f54-a3fb-a2b2d634d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:15.812795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38971e3c-ecec-4f54-a3fb-a2b2d634d3bf None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:15.813101 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38971e3c-ecec-4f54-a3fb-a2b2d634d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:15.813388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38971e3c-ecec-4f54-a3fb-a2b2d634d3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:15.825895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38971e3c-ecec-4f54-a3fb-a2b2d634d3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:15.827354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38971e3c-ecec-4f54-a3fb-a2b2d634d3bf None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-38971e3c-ecec-4f54-a3fb-a2b2d634d3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:15.845914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:15.846983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:15.848341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:15.848341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:15.848341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:15.848341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 306/612] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:15.858366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:15.886126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:15.897472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177bec-1a12-40f5-a9ec-f552ffb865a0 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:15.897818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177bec-1a12-40f5-a9ec-f552ffb865a0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:15.898224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177bec-1a12-40f5-a9ec-f552ffb865a0 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:15.899963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 307/613] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:15.905378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095b78-e9ed-438c-9b56-93eaf0a04302 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:15.905694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095b78-e9ed-438c-9b56-93eaf0a04302 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:15.906008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095b78-e9ed-438c-9b56-93eaf0a04302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:16.018338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b7095b78-e9ed-438c-9b56-93eaf0a04302 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:16.019509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b7095b78-e9ed-438c-9b56-93eaf0a04302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:16.070996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85573c-7aba-4c06-b417-74a2de6266ba None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:16.113799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:16.114431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:16.114741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:16.115024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:16.115728 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:16.116038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:16.122331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:16.143211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 307/614] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:16.150549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:16.208061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 308/615] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:09:16.271294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:16.301272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be5131-763f-4ea1-8004-7f81b0c27a51 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:16.347327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09c32-d17d-4b95-bfe6-b031010bd73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:16.347999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09c32-d17d-4b95-bfe6-b031010bd73c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:16.348351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09c32-d17d-4b95-bfe6-b031010bd73c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:16.348637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09c32-d17d-4b95-bfe6-b031010bd73c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:16.360875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09c32-d17d-4b95-bfe6-b031010bd73c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:16.362432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09c32-d17d-4b95-bfe6-b031010bd73c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f4d09c32-d17d-4b95-bfe6-b031010bd73c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:16.385193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:16.386318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:16.387831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 308/616] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:09:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:16.394612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7095b78-e9ed-438c-9b56-93eaf0a04302 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:16.471357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4d4b-9f5b-428f-99a8-54201935fa9e None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:16.471712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4d4b-9f5b-428f-99a8-54201935fa9e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:16.471954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4d4b-9f5b-428f-99a8-54201935fa9e None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:16.473584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 309/617] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:16.478750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e14e52-5fa6-4004-b254-da77aa3860a0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:16.479022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e14e52-5fa6-4004-b254-da77aa3860a0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:16.479299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e14e52-5fa6-4004-b254-da77aa3860a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:16.515789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e7e14e52-5fa6-4004-b254-da77aa3860a0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:16.518786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e7e14e52-5fa6-4004-b254-da77aa3860a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:16.544497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:16.586498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7095b78-e9ed-438c-9b56-93eaf0a04302 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:16.661475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:16.662494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:16.662972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:16.663539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:16.664665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:16.665199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:16.665803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 310/618] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:09:16.667101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e14e52-5fa6-4004-b254-da77aa3860a0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:16.667594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:16.692408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 309/619] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:09:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:16.702542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:16.754809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:16.791984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e14e52-5fa6-4004-b254-da77aa3860a0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:16.835849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:16.836943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:16.837410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:16.837942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:16.851831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:16.859743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:16.862087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:16.864438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 311/620] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:16.868522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:16.976049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbead7-1eca-4f94-b79c-b5845ccf8957 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.024608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401d57-f43d-418f-9c6c-21b9b933de95 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.033984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.034757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.035037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.035311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.050360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:17.068844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:17.079625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.080479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.080909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.081377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.082052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:17.082521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.084047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:17.097173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 312/621] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:17.097173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.142399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.147244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:17.229353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8678b-27c4-4e0b-8675-727fb637647b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.285465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.286281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.286733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.287072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.291510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 310/622] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:17.292397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.304603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:17.310120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:17.311072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:17.311885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 313/623] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:17.312552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.347110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:17.387922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:17.424042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac62cf-e68a-40d0-b046-a332b62c3ceb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.460268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd54c2-d752-4742-a772-7340c48d5428 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.478323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.479401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.479754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.480121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.502892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.503945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.504299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.504647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.505326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.507498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:17.518160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.520569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:17.532307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:17.533735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:17.538330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:17.538330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:17.538330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:17.541754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 311/624] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:17.543188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:17.544146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:17.545250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:17.546327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:17.546327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:17.546327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:17.552601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 314/625] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:17.554251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.670447 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:17.687053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b39ef-9154-46fe-8039-1bf0f6c04716 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.701961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:17.705976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f613-7df2-441f-ab58-9ca1a30a0339 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.726616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.727661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.728286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.728784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.729684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:17.730202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.731779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:17.741315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 312/626] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:17.743214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.758292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b2587-1d38-464a-ae06-87f62b7ae55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.759159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2587-1d38-464a-ae06-87f62b7ae55c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.759578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2587-1d38-464a-ae06-87f62b7ae55c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.760029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2587-1d38-464a-ae06-87f62b7ae55c None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.761230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2587-1d38-464a-ae06-87f62b7ae55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:17.761998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2587-1d38-464a-ae06-87f62b7ae55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.763382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2587-1d38-464a-ae06-87f62b7ae55c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:17.780750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 315/627] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:17.780750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db317-8a53-4ae6-816b-07bffcbc1cc4 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.780750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db317-8a53-4ae6-816b-07bffcbc1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.780750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db317-8a53-4ae6-816b-07bffcbc1cc4 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.780750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 316/628] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:17.780750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43db317-8a53-4ae6-816b-07bffcbc1cc4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.885971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34d607-566d-46f4-ac0d-73fa0a0908ec None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.922231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.923632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.924112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.924554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.924813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43db317-8a53-4ae6-816b-07bffcbc1cc4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:17.925688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:17.926181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.927831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:17.941009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 313/629] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:17.942415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:17.964999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:17.984540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c94438-d903-4e5d-b0e2-c0b3586d361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:17.985196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c94438-d903-4e5d-b0e2-c0b3586d361f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:17.985474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c94438-d903-4e5d-b0e2-c0b3586d361f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:17.986253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c94438-d903-4e5d-b0e2-c0b3586d361f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:17.997144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c94438-d903-4e5d-b0e2-c0b3586d361f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:17.998574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c94438-d903-4e5d-b0e2-c0b3586d361f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-57c94438-d903-4e5d-b0e2-c0b3586d361f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:18.013872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:18.015029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:18.015875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:18.015875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:18.015875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:18.015875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 317/630] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:18.016216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d30a1-0c19-4f62-a496-bae6a693496c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.016501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d30a1-0c19-4f62-a496-bae6a693496c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.016766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d30a1-0c19-4f62-a496-bae6a693496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.035618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9d4d30a1-0c19-4f62-a496-bae6a693496c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:18.036804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9d4d30a1-0c19-4f62-a496-bae6a693496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:18.044672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:18.062429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db44d50-5e2b-4531-9f4f-37c7531aae65 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.097103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9688-92b9-473b-a267-6afd9972e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.097690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9688-92b9-473b-a267-6afd9972e70e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.097962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9688-92b9-473b-a267-6afd9972e70e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.098239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9688-92b9-473b-a267-6afd9972e70e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.105686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9688-92b9-473b-a267-6afd9972e70e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.106568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 318/631] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:18.107158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9688-92b9-473b-a267-6afd9972e70e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.107273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d30a1-0c19-4f62-a496-bae6a693496c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c5ff9688-92b9-473b-a267-6afd9972e70e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:18.120469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:18.121619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:18.123223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:18.125482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 314/632] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:18.127223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809db7b-8e6f-49a2-bfbc-1be5d6279e05 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.127513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809db7b-8e6f-49a2-bfbc-1be5d6279e05 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.127909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809db7b-8e6f-49a2-bfbc-1be5d6279e05 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.129964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 315/633] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:18.133916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809db7b-8e6f-49a2-bfbc-1be5d6279e05 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.220844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:18.235097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d30a1-0c19-4f62-a496-bae6a693496c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.254520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809db7b-8e6f-49a2-bfbc-1be5d6279e05 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.274439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.275336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.275932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.276203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.284061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.285834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.292724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1604a-3309-456e-b393-c56a0eb96679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.293369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1604a-3309-456e-b393-c56a0eb96679 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.293645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1604a-3309-456e-b393-c56a0eb96679 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.293913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1604a-3309-456e-b393-c56a0eb96679 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.294550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1604a-3309-456e-b393-c56a0eb96679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:18.294847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1604a-3309-456e-b393-c56a0eb96679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.296198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1604a-3309-456e-b393-c56a0eb96679 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:18.297950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:18.299401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:18.300325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 319/634] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:18.301301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.303768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:18.314395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 316/635] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:18.315677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285123-5140-410f-9573-ab93058d6085 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.315961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285123-5140-410f-9573-ab93058d6085 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.316231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285123-5140-410f-9573-ab93058d6085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.337981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-39285123-5140-410f-9573-ab93058d6085 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:18.339194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-39285123-5140-410f-9573-ab93058d6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:18.411070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 317/636] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:18.412055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285123-5140-410f-9573-ab93058d6085 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.431470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf571045-54fb-4423-8b79-386358f16471 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.475922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.476431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.476726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.476982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.477749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:18.478062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.479579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.491657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:18.508772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 320/637] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:18.508772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.543457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285123-5140-410f-9573-ab93058d6085 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.578812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:18.586935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33211471-8961-467e-97c1-d127ab05592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.587555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211471-8961-467e-97c1-d127ab05592b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.587932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211471-8961-467e-97c1-d127ab05592b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.588100 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211471-8961-467e-97c1-d127ab05592b None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.588950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33211471-8961-467e-97c1-d127ab05592b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:18.592180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33211471-8961-467e-97c1-d127ab05592b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.592180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33211471-8961-467e-97c1-d127ab05592b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.609309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 318/638] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:18.609309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33211471-8961-467e-97c1-d127ab05592b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.637398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85c5e-bb33-4d1f-ac51-0ca53a747a97 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.682771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.683417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.683701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.683979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.691701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.693287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:18.705980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:18.707708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 321/639] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:18.710010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.741849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33211471-8961-467e-97c1-d127ab05592b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.766161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:18.778689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.779328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.779614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.779889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.791279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:18.796386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:18.797377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 319/640] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:18.798908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.816588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f1d12-4c30-4042-b74c-f66dbd22f263 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.838830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:18.855874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.856881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.857365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.857743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.874307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.876999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:18.899859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:18.900916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:18.901856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:18.901856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:18.901856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:18.901856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 322/641] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:18.902097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:18.910242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866013-9310-4c4f-881f-240745f8fd45 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:18.946938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:18.947701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:18.947977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:18.948315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:18.949038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=5546fd3a7c324d4583817707572b1245) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:18.950271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:18.950790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:18.956771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 320/642] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/role_assignments?user.id=5546fd3a7c324d4583817707572b1245&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:18.958055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.021148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.031823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647dcfe-320e-40cb-81b2-0c3d80ae4853 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.071971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.072723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.072876 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.073155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.084679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:19.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:19.091133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:19.092093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 323/643] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:19.092887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.094857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f32aa-2f07-423b-8357-8bc8b80ca9dc None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.137846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.147944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.148593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.206560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.206560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.206560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:19.206560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.206560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.206560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 321/644] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 21:09:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:19.208199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.213723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88993e-48c6-4559-a763-f2016234f1f4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.259425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.260039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.260316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.260586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.261318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:19.261625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.263001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.273193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 324/645] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:19.274201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.296946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90d8fa-e146-43cd-8e8d-f3c45634f62f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.299485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.337608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.338226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.338506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.338791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.339421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:19.339723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.341163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.353885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 322/646] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:19.354733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.388240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.396090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa216-ea1d-4b8a-b345-4de1663ae223 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.433581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.434193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.434469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.434730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.434730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:19.434730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.437180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.450738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 325/647] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:19.450738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.478221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232ef06-6082-4f5d-8fe7-6eb5b9ac8cb4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.517711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.518354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.518662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.518936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.552560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.565151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b92dc8-b340-4f04-8744-4a6c67c33cbf None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.595389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.596845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.605207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.605954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.606305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.606652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.620022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.621706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:19.638128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:19.639132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:19.639992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:19.639992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:19.639992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:19.639992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 326/648] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:19.640539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.656399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.733666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 323/649] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:19.734571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.763218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52caa64-c54d-425b-b476-8aaf628037d3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.802022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.802813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.803038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.803309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.810885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.812325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.815440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:19.824371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:19.825331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:19.826237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 327/650] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:19.826713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.864010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b544e-1fb1-4ede-8568-5526f4d242e8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.899861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.900497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.900774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.901046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:19.912393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:19.913670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:19.915278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:19.932004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:19.932996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:19.933907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:19.933907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:19.933907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:19.933907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 324/651] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:19.933907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:19.956472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031c119-0a48-4608-b3d6-4deb23891bbd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:19.998431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:19.999038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:19.999312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:19.999581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.000232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:20.000531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.001973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.015189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 328/652] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:20.016062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.060125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d7f0-81d6-490e-a447-c925e606ee5c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.081609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:20.104580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.105264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.105691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.105953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.129582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.131066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.140078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee3589-54fe-4fe7-81e7-2d1803d17788 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:20.147305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:20.148726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:20.149853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:20.149853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:20.149853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:20.153012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 325/653] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:20.153802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.174047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:20.187258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.188185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.188631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.189895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.190183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:20.190678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.193460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.216102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 329/654] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:20.216102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.294272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821eb30-bac7-452e-8f6d-86ec13a3ef15 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.325759 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d08dbd-2355-43a3-9a45-1e4a81ab9b08 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.334772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.335704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.336153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.336592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.337885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:20.337885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.339969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.362464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 326/655] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:20.362464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.379960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.380694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.381009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.381295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.389823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.391290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:20.403794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:20.404848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 330/656] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:20.405875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.408504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:20.468124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:20.488594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e497-1ac0-407c-be18-8c3a5134626b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.530366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.531102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.531387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.531660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.532359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:20.532652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.534037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.541038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5aeb-0af7-4d77-8cf4-c12abed6a665 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.547130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 327/657] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:20.548197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.582584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.583167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.583487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.583747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/afacbc4812494825a43083cbba245e4f/roles/290a4533dad74846ae9cadca3f9000e5` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.600176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=afacbc4812494825a43083cbba245e4f, role_id=290a4533dad74846ae9cadca3f9000e5)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.601695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.647693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:20.660122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061c11-f64d-481b-8efb-a902feec6fe5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.699332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.699974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.700244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.700514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.703852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 331/658] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:20 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/afacbc4812494825a43083cbba245e4f/roles/290a4533dad74846ae9cadca3f9000e5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:20.704790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.712194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.714084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:20.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:20.736063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:09:20.737477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:20.741633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 328/659] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:20.742822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.855975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:20.862168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23a06-6eb3-40d8-8a2d-a79fe0c05715 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.895013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882944bd-aa55-4b88-896e-442e68a00f8c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:20.906773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.907934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.908449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.908955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.910391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:20.910926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.914228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.934926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:20.935916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:20.936484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:20.936966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:20.945807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:20.947573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:20.954550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 332/660] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:20.959217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:20.960582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:20.961528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:20.962411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 329/661] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:20.963178 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:20.975712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:21.083203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdd85b-8886-427f-83cd-17cc0078a779 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:21.086582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bce95-224d-4f5e-957d-cb36dca0846c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:21.124448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:21.124928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.125270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.125547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.126341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:21.126648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:21.126948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:21.128072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:21.128275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.128733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.129232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.150175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 333/662] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:21.151172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:21.167499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:21.213812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:21.215543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:21.227495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:21.266685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b3868-56c1-4aae-a3d0-54f8021e5429 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:21.305453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8432a6d-883a-48af-87ca-c552cfe51cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:21.306068 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8432a6d-883a-48af-87ca-c552cfe51cfd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.306341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8432a6d-883a-48af-87ca-c552cfe51cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.306610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8432a6d-883a-48af-87ca-c552cfe51cfd None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.307307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8432a6d-883a-48af-87ca-c552cfe51cfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:21.307612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8432a6d-883a-48af-87ca-c552cfe51cfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:21.309055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8432a6d-883a-48af-87ca-c552cfe51cfd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:21.322084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 334/663] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:21.324312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074beb8-5c5a-4613-a3bf-547926bf41fe None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.324595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074beb8-5c5a-4613-a3bf-547926bf41fe None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.324926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074beb8-5c5a-4613-a3bf-547926bf41fe None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.327204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 335/664] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:21.328029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074beb8-5c5a-4613-a3bf-547926bf41fe None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:21.352102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 330/665] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:21.353495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:21.421556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:21.449562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074beb8-5c5a-4613-a3bf-547926bf41fe None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:21.472576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343829c-84b5-42d4-9e47-de46919b1f46 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:21.482317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:21.491979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:21.492611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.492891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.493191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.508930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3922-bc2a-4534-95ef-a7dba3202030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:21.509615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3922-bc2a-4534-95ef-a7dba3202030 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.509895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3922-bc2a-4534-95ef-a7dba3202030 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.510187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3922-bc2a-4534-95ef-a7dba3202030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.510905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3922-bc2a-4534-95ef-a7dba3202030 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=01d2e6366b3c488c8b893584f59a98db) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:21.511214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3922-bc2a-4534-95ef-a7dba3202030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:21.512622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3922-bc2a-4534-95ef-a7dba3202030 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:21.520256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 331/666] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:21 2022] GET /identity/v3/role_assignments?user.id=01d2e6366b3c488c8b893584f59a98db&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:21.521866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49abe-a03c-4d07-9beb-eb0f9adcc70b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.522353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49abe-a03c-4d07-9beb-eb0f9adcc70b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.522839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49abe-a03c-4d07-9beb-eb0f9adcc70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.548636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d0b49abe-a03c-4d07-9beb-eb0f9adcc70b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:21.549918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d0b49abe-a03c-4d07-9beb-eb0f9adcc70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:21.588636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:21.590320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:21.643852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 332/667] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:21.645315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49abe-a03c-4d07-9beb-eb0f9adcc70b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:21.704797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:21.741184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 336/668] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:21.744339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:21.806465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49abe-a03c-4d07-9beb-eb0f9adcc70b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:21.808337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:21.869464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:21.870137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.870427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.870706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.884120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adcd77-6f9e-4ae9-95a4-abcf7b512960 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:21.884860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:21.886430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:21.904045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:21.905787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:21.906848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:21.906848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:21.906848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:21.906848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 333/669] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:21.912650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:21.945708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:21.946662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:21.946662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:21.946919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:21.964631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:21.966059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:21.995627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:21.996615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:21.998119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:21.998119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:21.998119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:21.998119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 337/670] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:22.003730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.046067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.050580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d254c2-dc8b-450c-b9ec-035a64ddd535 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.090019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.090987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.091468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.091961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.092815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:22.093349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.094948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.113047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 334/671] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:22.114671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.132689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.133465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c70e-dba2-4198-a09b-dce3b86f178c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.171007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.171643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.171861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.172130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.172770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:22.173626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.175949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.198516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 338/672] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:22.199455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.227403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8497f59-7a7f-4480-bf45-305adb14061e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.265769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.266839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.267323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.267897 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.280146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:22.285705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:22.286985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:22.287799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:22.290654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 335/673] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:22.291706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.306992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.327065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2a3ff-0ecf-4e5a-8bc7-93cf7c14c6dc None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.366897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.367531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.367807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.368074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.378786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.380319 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.381481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:22.393757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:22.397671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 339/674] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:22.398556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.413156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fe41d-95f7-472f-91eb-09d64e112a7f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.450441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.451192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.451539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.451924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.459173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.460731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:22.473113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:22.474943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 336/675] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:22.477120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.517083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e56bb1-b147-468a-bfe8-84582252f865 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.556444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.557223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.557506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.557770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.558446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:22.558743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.560225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.577386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 340/676] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:22.578513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.584860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866bb3d-9a19-462b-9f32-47dd38ac30f5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.591265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.623415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.624036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.624317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.624589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.625362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:22.625677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.627362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.629308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.645640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 337/677] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:22.646655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.701026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d6b6-408b-4688-8aad-cc230ef86d17 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.740869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.741788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.742230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.742649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.743646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:22.744104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.745951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.760350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8897cac-dd4c-4bca-ad6e-3647bc1b7b46 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.763146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 341/678] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:22.764086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.809108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53289fc8-5d6e-4fe4-b216-eaf8d5e1a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.809684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53289fc8-5d6e-4fe4-b216-eaf8d5e1a799 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.809971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53289fc8-5d6e-4fe4-b216-eaf8d5e1a799 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.810245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53289fc8-5d6e-4fe4-b216-eaf8d5e1a799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.822217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53289fc8-5d6e-4fe4-b216-eaf8d5e1a799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.823619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53289fc8-5d6e-4fe4-b216-eaf8d5e1a799 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-53289fc8-5d6e-4fe4-b216-eaf8d5e1a799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:22.841652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:22.842635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:22.843488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:22.843488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:22.843488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:22.843488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 338/679] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:22.844426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b262a7-70fb-43ae-a681-32ffae3d6fd6 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.844426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b262a7-70fb-43ae-a681-32ffae3d6fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.844585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b262a7-70fb-43ae-a681-32ffae3d6fd6 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.846589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 339/680] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:22.847197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b262a7-70fb-43ae-a681-32ffae3d6fd6 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.870268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.901565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:22.903033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d2de0-7d22-419c-800a-4f3dbcdd48b3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:22.939145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:22.939771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:22.940054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:22.940325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:22.941114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=b56b3fafca1e47f88482bf25a77a0fea) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:22.941670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:22.943134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:22.950248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 342/681] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/role_assignments?user.id=b56b3fafca1e47f88482bf25a77a0fea&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:22.951009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:22.998687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b262a7-70fb-43ae-a681-32ffae3d6fd6 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:23.060720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e81e40-99f4-45f4-a8e0-ec4fb498552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:23.061640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e81e40-99f4-45f4-a8e0-ec4fb498552f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:23.062588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e81e40-99f4-45f4-a8e0-ec4fb498552f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:23.063040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e81e40-99f4-45f4-a8e0-ec4fb498552f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:23.064746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e81e40-99f4-45f4-a8e0-ec4fb498552f None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=e72f7d1f9961446c8938e3f161fb03f7) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:23.065341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e81e40-99f4-45f4-a8e0-ec4fb498552f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:23.069166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e81e40-99f4-45f4-a8e0-ec4fb498552f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:23.085392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 340/682] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/role_assignments?user.id=e72f7d1f9961446c8938e3f161fb03f7&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:23.087661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f955-a552-4751-a1f6-5158c0e872f7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:23.088103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f955-a552-4751-a1f6-5158c0e872f7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:23.088528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f955-a552-4751-a1f6-5158c0e872f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:23.128692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-38e9f955-a552-4751-a1f6-5158c0e872f7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:23.130458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-38e9f955-a552-4751-a1f6-5158c0e872f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:23.161718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629d8e-640a-4dad-8275-f11faa58c4e0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:23.228550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 341/683] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:23.230391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:23.240453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:23.242705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:23.242705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:23.242705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:23.242705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:23.242705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:23.244147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:23.258460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 343/684] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:23.264278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f955-a552-4751-a1f6-5158c0e872f7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:23.317866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:23.398359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f955-a552-4751-a1f6-5158c0e872f7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:23.440451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:23.441148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:23.441687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:23.441962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:23.451842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:23.453371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:23.468299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:23.469397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:23.470952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:23.471524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 342/685] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:09:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:23.476362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:23.544857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:23.660580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f6af-7a08-4db1-bc8a-f7a59aa933e6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:23.738172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:23.740140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:23.744538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:23.745165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:23.746144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:23.746679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:23.748544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:23.772926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:23.776891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df5f19-c6ef-4508-9475-dd9eff130fdc None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:23.793491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 344/686] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:09:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:23.817369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:23.837206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:23.838236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:23.838721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:23.839166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:23.854131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:23.860314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:23.861382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:23.862238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:23.865051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 343/687] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:23.872072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:23.937904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:24.002092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e35c15-6768-409f-a5db-e86f9863803e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:24.011924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad16c-2981-4ff8-9245-a5daa039ef45 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:24.058249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0ba89-334c-479b-89c7-865485d2e244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:24.058847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10ff5-8552-430c-b881-5b817bf7f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:24.059045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ba89-334c-479b-89c7-865485d2e244 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.059189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ba89-334c-479b-89c7-865485d2e244 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.059444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ba89-334c-479b-89c7-865485d2e244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.060407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10ff5-8552-430c-b881-5b817bf7f549 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.060836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10ff5-8552-430c-b881-5b817bf7f549 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.061294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10ff5-8552-430c-b881-5b817bf7f549 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.062231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10ff5-8552-430c-b881-5b817bf7f549 None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:24.062689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10ff5-8552-430c-b881-5b817bf7f549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:24.064900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10ff5-8552-430c-b881-5b817bf7f549 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:24.075539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 344/688] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:24.077396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339416-7d34-4cae-b83c-39d02a489561 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.078024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339416-7d34-4cae-b83c-39d02a489561 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.078503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339416-7d34-4cae-b83c-39d02a489561 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.085406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 345/689] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:24.086741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33339416-7d34-4cae-b83c-39d02a489561 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:24.120137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:24.150477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0ba89-334c-479b-89c7-865485d2e244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:24.152911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0ba89-334c-479b-89c7-865485d2e244 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:24.212823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:24.224790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33339416-7d34-4cae-b83c-39d02a489561 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:24.269614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:24.270999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.271452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.272024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.280477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 345/690] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:09:24.281915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a467-5526-4326-801f-f7881295dc53 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.282782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a467-5526-4326-801f-f7881295dc53 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.282976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a467-5526-4326-801f-f7881295dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.285250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:24.287097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:24.304913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-dfa4a467-5526-4326-801f-f7881295dc53 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:24.305441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:24.306646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:24.307813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:24.307813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:24.307813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:24.308230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-dfa4a467-5526-4326-801f-f7881295dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:24.309918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 346/691] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:24.311122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:24.414814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:24.424595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 346/692] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:24.426102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a467-5526-4326-801f-f7881295dc53 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:24.446057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d931-a844-4bd7-96df-84568ebb02e2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:24.491545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:24.492601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.493230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.493767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.510383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:24.512328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:24.524235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:24.530991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:24.531975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:24.533124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:24.533124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:24.533124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:24.535411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 347/693] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:24.550804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:24.554487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a467-5526-4326-801f-f7881295dc53 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:24.612649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:24.613741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.613853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.614098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.615873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:24.616182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:24.620182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:24.652758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 347/694] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:24.661755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:24.794480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879293a8-20c0-49b6-bce0-060e207f494b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:24.825552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe9913-89cc-44c8-96c5-d642de30e26a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:24.829456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:24.836938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:24.838034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.838497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.839721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.840670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:24.841212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:24.843745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:24.862189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 348/695] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:24.864182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:24.875665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:24.876422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:24.876838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:24.877418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:24.886446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:24.888060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:24.892245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:24.903942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:24.904949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:24.906135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 348/696] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:24.907019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.008818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0dc8-0815-4644-8a3d-87f702f38235 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.060972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.061928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.062638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.063114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.064474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.067545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:25.083687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:25.084817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:25.085725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:25.092059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 349/697] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 29 21:09:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:25.092059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.106968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc403-6a6c-44a8-b925-1d0804cfa163 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.158363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:25.174677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.175959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.176559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.177035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.190981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.194805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:25.220563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:25.221625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:25.222530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:25.223911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 349/698] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:25.224449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869497b-853b-401b-a27a-824ea8686c70 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.225672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.266967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.267923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.268404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.268863 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.270503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:25.271427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.273352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.301374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 350/699] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 21:09:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:25.302656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.328552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:25.375382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c3e2-d415-4f3d-ab4e-0af6e47fc23b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.419347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ab1c6-e736-4b16-ae20-043882a4704d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.422561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.422799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.423084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.423376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.424046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:25.424355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.426160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.430792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:25.432465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 350/700] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 21:09:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:25.433623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.463851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.464749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.465038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.465376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.466077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:25.466388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.468583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.489261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 351/701] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:25.491339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.572986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db479c-a674-4d96-b23b-31166b21548c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.602205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:25.610990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5e27-f13c-45a3-95cf-51bce93adcc2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.612815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f9fb5-b468-4d6f-b046-9dd5f3fb47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.613469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f9fb5-b468-4d6f-b046-9dd5f3fb47ae None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.613748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f9fb5-b468-4d6f-b046-9dd5f3fb47ae None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.614070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f9fb5-b468-4d6f-b046-9dd5f3fb47ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.650460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.651072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.651351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.651624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.652816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:25.652816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.654409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.660354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 352/702] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 21:09:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:25.661185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.699460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:25.721856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f9fb5-b468-4d6f-b046-9dd5f3fb47ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.723343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f9fb5-b468-4d6f-b046-9dd5f3fb47ae None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.801948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94d8f8-5db7-4c8a-b715-76625c13f665 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:25.852353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 351/703] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:09:25.852353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f3ba4-77bd-4450-8eda-d4b968ffe898 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.852353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f3ba4-77bd-4450-8eda-d4b968ffe898 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.852353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f3ba4-77bd-4450-8eda-d4b968ffe898 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.855462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 352/704] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:25.857528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59db7-1ccb-4e27-8dc2-e4766c8f0d1f None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.857822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59db7-1ccb-4e27-8dc2-e4766c8f0d1f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.858104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59db7-1ccb-4e27-8dc2-e4766c8f0d1f None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.859700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 353/705] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:25.860204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e59db7-1ccb-4e27-8dc2-e4766c8f0d1f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:25.865919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b65b2-7058-463d-aa8b-a157c32f437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:25.866619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b65b2-7058-463d-aa8b-a157c32f437a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.866872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b65b2-7058-463d-aa8b-a157c32f437a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.867142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b65b2-7058-463d-aa8b-a157c32f437a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.867869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b65b2-7058-463d-aa8b-a157c32f437a None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=5546fd3a7c324d4583817707572b1245) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:25.868176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b65b2-7058-463d-aa8b-a157c32f437a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:25.869748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b65b2-7058-463d-aa8b-a157c32f437a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:25.876660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 353/706] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:25 2022] GET /identity/v3/role_assignments?user.id=5546fd3a7c324d4583817707572b1245&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:25.881095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77e8f3-7d23-4e18-8189-2d1745b233b7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:25.881095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77e8f3-7d23-4e18-8189-2d1745b233b7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:25.881095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77e8f3-7d23-4e18-8189-2d1745b233b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:25.899437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2a77e8f3-7d23-4e18-8189-2d1745b233b7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:25.901320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2a77e8f3-7d23-4e18-8189-2d1745b233b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:25.904005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:26.003660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 354/707] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:26.005101 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0ff7-a21b-45b7-a5f3-dc665f5911b1 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:26.005399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0ff7-a21b-45b7-a5f3-dc665f5911b1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:26.005681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0ff7-a21b-45b7-a5f3-dc665f5911b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:26.024315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e59db7-1ccb-4e27-8dc2-e4766c8f0d1f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:26.028514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b01c0ff7-a21b-45b7-a5f3-dc665f5911b1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:26.030248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b01c0ff7-a21b-45b7-a5f3-dc665f5911b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:26.062893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:26.088965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:26.090536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:26.091333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:26.092181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:26.110052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:26.112610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:26.124677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 355/708] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:26.135386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:26.136422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:26.137479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:26.137479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:26.137479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:26.139709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 354/709] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:26.145444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c0ff7-a21b-45b7-a5f3-dc665f5911b1 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:26.313893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c0ff7-a21b-45b7-a5f3-dc665f5911b1 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:26.364352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:26.365091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:26.365391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:26.365665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:26.366400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:26.366707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:26.367068 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:26.368182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:26.386411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 356/710] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:26.387826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:26.416039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:26.498389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:26.527883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8596-eaf2-4f0b-8584-99c15b401910 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:26.551706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb8a2-e93c-480a-9fc1-af74c07e83bf None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:26.572027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:26.572949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:26.573321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:26.573661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:26.587168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:26.589526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:26.595642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:26.596983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:26.597512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:26.597935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:26.605936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:26.607136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:26.608282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:26.608282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:26.608282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:26.608661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:26.610791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:26.613366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 355/711] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:26.614716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:26.625001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:26.626686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:26.627644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:26.634604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 357/712] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:26.634604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:26.736078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:26.767804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ae91b-ab8b-4f08-8845-06ffbafabd04 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:26.776809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a475a-4152-4d3b-bbd1-477769cb6eb3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:26.812578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:26.818480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:26.819518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:26.820049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:26.822441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:26.822441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:26.822623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:26.822741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:26.822848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:26.823260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:26.823689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] PATH_INFO: `/v3/services/network` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:26.824503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:26.824881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:26.826250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:26.844725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 358/713] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:26.847043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:26.852758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:26.856958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:26.859785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 356/714] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:26 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:26.861334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:26.991993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a0ead-9322-4882-a065-9069b37e1bd0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:27.014431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1181d-fb49-4800-a7f3-57110eb1d4de None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:27.042516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:27.045242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:27.045682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:27.046176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:27.047707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:27.048196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:27.050809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:27.054248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:27.070781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 359/715] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:27.072278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:27.077711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:27.078174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:27.078533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:27.078926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:27.080607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:27.083164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:27.207778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 357/716] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:09:26 2022] POST /identity/v3/users => generated 254 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:27.208631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:27.243069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a329c9-c572-46b3-a1d9-52ab914f8c30 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:27.317110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:27.319731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:27.321261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:27.321952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:27.324123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] RBAC: Adding query filter params (name=network) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:27.324682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:27.325551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:27.327699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:27.333922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 360/717] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:27.350873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:27.395861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51642f-3f52-4210-899d-49b59096a6f5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:27.433649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887793f-8e61-4a8f-b707-5600d9d98a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:27.434287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887793f-8e61-4a8f-b707-5600d9d98a07 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:27.434566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887793f-8e61-4a8f-b707-5600d9d98a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:27.434887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887793f-8e61-4a8f-b707-5600d9d98a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:27.435788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887793f-8e61-4a8f-b707-5600d9d98a07 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=afacbc4812494825a43083cbba245e4f) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:27.435931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887793f-8e61-4a8f-b707-5600d9d98a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:27.437613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887793f-8e61-4a8f-b707-5600d9d98a07 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:27.444484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 358/718] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:27 2022] GET /identity/v3/role_assignments?user.id=afacbc4812494825a43083cbba245e4f&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:27.478549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:27.550383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af37d9-a3d0-456f-85fd-86aa9520c217 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:27.601118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0f47a-f6a6-42b7-b869-1af8dc6c34de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:27.601879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f47a-f6a6-42b7-b869-1af8dc6c34de None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:27.602199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f47a-f6a6-42b7-b869-1af8dc6c34de None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:27.602474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f47a-f6a6-42b7-b869-1af8dc6c34de None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:27.603128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0f47a-f6a6-42b7-b869-1af8dc6c34de None admin] RBAC: Adding query filter params (type=network) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:27.603435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0f47a-f6a6-42b7-b869-1af8dc6c34de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:27.604850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0f47a-f6a6-42b7-b869-1af8dc6c34de None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:27.612955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 361/719] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:28.047414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a0f2-debd-47af-8eaf-792a9bbba9b7 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:28.048459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a0f2-debd-47af-8eaf-792a9bbba9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:28.048938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a0f2-debd-47af-8eaf-792a9bbba9b7 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:28.051648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 359/720] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:28.060235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252d078-50c1-4d98-829c-8480bc17845c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:28.060696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252d078-50c1-4d98-829c-8480bc17845c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:28.061190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252d078-50c1-4d98-829c-8480bc17845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:28.094193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-0252d078-50c1-4d98-829c-8480bc17845c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:28.096483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0252d078-50c1-4d98-829c-8480bc17845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:28.179856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027935f-bfa7-455b-9f3c-317292b49209 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:28.180049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027935f-bfa7-455b-9f3c-317292b49209 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:28.180316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027935f-bfa7-455b-9f3c-317292b49209 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:28.182030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 360/721] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:28.187353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66a68f-d8f8-43ae-9e91-17520f3a82e4 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:28.187677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66a68f-d8f8-43ae-9e91-17520f3a82e4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:28.187951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66a68f-d8f8-43ae-9e91-17520f3a82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:28.210337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 362/722] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:09:28.234631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4a66a68f-d8f8-43ae-9e91-17520f3a82e4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:28.236599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4a66a68f-d8f8-43ae-9e91-17520f3a82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:28.370712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 361/723] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:28.725318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252d078-50c1-4d98-829c-8480bc17845c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:28.787617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66a68f-d8f8-43ae-9e91-17520f3a82e4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:28.806923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:28.845620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:28.949874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252d078-50c1-4d98-829c-8480bc17845c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:29.015676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66a68f-d8f8-43ae-9e91-17520f3a82e4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:29.067109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:29.068153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:29.068646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:29.069149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:29.070327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:29.072851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:29.116649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:29.117366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:29.117648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:29.117916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:29.133550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:29.138382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:29.139433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:29.140357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 362/724] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:29.148956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:29.230472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 363/725] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:09:28 2022] POST /identity/v3/services => generated 251 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:29.293290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b60b5-4a60-4fff-be83-58d72cca9d03 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:29.294875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:29.357459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:29.358386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:29.358669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:29.358939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:29.359672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:29.359976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:29.362144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:29.373626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 363/726] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:29.379287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:29.564331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c99c2-39ce-490f-b49f-f1f2e8d42239 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:29.595670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:29.623786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041263af-5771-4839-8603-f0c178e08102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:29.624430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041263af-5771-4839-8603-f0c178e08102 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:29.624706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041263af-5771-4839-8603-f0c178e08102 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:29.625170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041263af-5771-4839-8603-f0c178e08102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:29.652471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041263af-5771-4839-8603-f0c178e08102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:29.654019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041263af-5771-4839-8603-f0c178e08102 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-041263af-5771-4839-8603-f0c178e08102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:29.672302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:29.678022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:29.679847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:29.679847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:29.679847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:29.679847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 364/727] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:29.684512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:29.792560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec91d2-b85a-4d91-90af-c2892eeccdbf None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:29.842284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:29.842871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:29.843157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:29.843432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:29.844095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:29.844400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:29.846545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:29.860262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 364/728] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:29.866542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041263af-5771-4839-8603-f0c178e08102 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:29.981936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041263af-5771-4839-8603-f0c178e08102 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:30.037339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83870e-5369-4079-8f84-b2f0369df968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:30.038074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83870e-5369-4079-8f84-b2f0369df968 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.038361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83870e-5369-4079-8f84-b2f0369df968 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.038633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83870e-5369-4079-8f84-b2f0369df968 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.052255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83870e-5369-4079-8f84-b2f0369df968 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:30.053724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83870e-5369-4079-8f84-b2f0369df968 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-af83870e-5369-4079-8f84-b2f0369df968 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:30.072086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:30.073960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:30.077603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 365/729] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:09:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:30.086654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:30.117865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:30.205865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd3aff-7cc6-4c1e-ac1b-4e33bf825912 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:30.239505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edaa06-2c5f-4441-b79e-cbf441804a80 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.239896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edaa06-2c5f-4441-b79e-cbf441804a80 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.240150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edaa06-2c5f-4441-b79e-cbf441804a80 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.241640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 366/730] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:09:30.245823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:30.246434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.246698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.246944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.247677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:30.247979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:30.248217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aace42-f9e9-42fb-965b-d7c8e8d47669 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.248578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aace42-f9e9-42fb-965b-d7c8e8d47669 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.249083 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aace42-f9e9-42fb-965b-d7c8e8d47669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.249433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:30.269029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 365/731] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:09:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:30.274687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:30.307206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a0aace42-f9e9-42fb-965b-d7c8e8d47669 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:30.309422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a0aace42-f9e9-42fb-965b-d7c8e8d47669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:30.358050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:30.380889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34310829-0fd3-4351-a09c-d0203808a2b8 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:30.385620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:30.417596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:30.418227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.418506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.418770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.430955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:30.432412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:30.449101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:30.452565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:30.456842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:30.456842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:30.456842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:30.456842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 366/732] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:30.456842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:30.483259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 367/733] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:30.542640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536e73-9f6b-44e9-852b-8b836f621d75 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.543036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536e73-9f6b-44e9-852b-8b836f621d75 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.543302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536e73-9f6b-44e9-852b-8b836f621d75 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.544738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 368/734] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:30.554398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8b23-c639-4310-ac32-f9561c96c1bb None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.554757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8b23-c639-4310-ac32-f9561c96c1bb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.555029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8b23-c639-4310-ac32-f9561c96c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.565052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f8417-ba20-4941-94aa-8de9c5b5cc0d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:30.593645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-92ae8b23-c639-4310-ac32-f9561c96c1bb None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:30.595315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-92ae8b23-c639-4310-ac32-f9561c96c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:30.597691 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:30.604760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:30.605401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.605658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.605998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.606703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:30.607005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:30.608377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:30.642316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 367/735] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:30.649287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:30.725692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 369/736] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:30.727237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e74ec-53bc-4bba-a106-d442f933060a None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.727705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e74ec-53bc-4bba-a106-d442f933060a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.728120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e74ec-53bc-4bba-a106-d442f933060a None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.733681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 370/737] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:30.735012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236ac7e-d8a6-454d-876c-47c25b289f73 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.735486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236ac7e-d8a6-454d-876c-47c25b289f73 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.735906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236ac7e-d8a6-454d-876c-47c25b289f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.761862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5236ac7e-d8a6-454d-876c-47c25b289f73 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:30.763397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5236ac7e-d8a6-454d-876c-47c25b289f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:30.847092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00f01-2bc9-45a4-942a-c46b3aff64a3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:30.877929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 371/738] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:09:30.879444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236ac7e-d8a6-454d-876c-47c25b289f73 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:30.908348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:30.915165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:30.915818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:30.918599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:30.918599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:30.934171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:30.935658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:30.959652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:30.960618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:30.961517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:30.965187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 368/739] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:30.969076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.001808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236ac7e-d8a6-454d-876c-47c25b289f73 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.040140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.041250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.041757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.042381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.060698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:31.061344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:31.067024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:31.068080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:31.068889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:31.073628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 372/740] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:31.073628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.134246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d515c6-9913-4115-bf4b-b2399714b61c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.170529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:31.174461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.175601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.176170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.176687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.177688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:31.187476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:31.187476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:31.194237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 369/741] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:31.195411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.195912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad59fd9-bb94-43db-a0df-233316a20b2f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.231210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.231817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.232092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.232362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.233100 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:31.234523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:31.313005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387586-24c5-4a18-8f18-3e678644e68a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.329816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:31.337261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 373/742] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:09:31 2022] POST /identity/v3/services => generated 240 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:31.337261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.357624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.358396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.358770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.359141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.359961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:31.360867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:31.362404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:31.371914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 370/743] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:31.373573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.496250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da0185-689f-41d2-88e5-6cd75fd28ab6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.507995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e77ed-e15a-488a-a0cf-eb237a22ea92 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.539051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.539948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.540327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.540697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.544876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:31.556175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:31.566064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:31.566837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:31.567690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:31.568494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:31.569672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.569672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.569672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/5546fd3a7c324d4583817707572b1245/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.569672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=5546fd3a7c324d4583817707572b1245, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:31.571078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:31.573376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 374/744] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:31.574691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.672303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 371/745] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:31 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/5546fd3a7c324d4583817707572b1245/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:31.677467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.735535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5da2a3-a8e7-41c0-9a68-8574b91a38d4 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.751478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:31.798273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.799629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.800125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.800632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.816240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:31.818640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:31.852884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:31.853941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:31.855173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:31.855173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:31.855173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:31.862329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 375/746] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:31.868737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:31.911889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea564-71d5-4e83-9d7a-c618c7ace233 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:31.962807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:31.965619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:31.966371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:31.966755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:31.967134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:31.968219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:31.968658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:31.970996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:31.985868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 372/747] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:32.004226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:32.014867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6509b8-0e0f-467d-af45-8388c7ce476e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:32.054951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:32.055627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.055916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.056192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:32.057024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:32.057368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:32.059091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:32.085132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 376/748] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:32.085132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:32.241468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:32.252223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f513ae-48ce-4942-9848-d9e39674cc3c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:32.287055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0488e-3ecd-401a-a452-063093fe6322 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:32.299041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:32.314794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9010b-b3c4-436e-b78f-7a9221d97038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:32.315787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9010b-b3c4-436e-b78f-7a9221d97038 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.316812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9010b-b3c4-436e-b78f-7a9221d97038 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.317335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9010b-b3c4-436e-b78f-7a9221d97038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:32.328404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04635ca-1e26-4d95-87e8-5e5d532696b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:32.329097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04635ca-1e26-4d95-87e8-5e5d532696b5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.329426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04635ca-1e26-4d95-87e8-5e5d532696b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.329741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04635ca-1e26-4d95-87e8-5e5d532696b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:32.332459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9010b-b3c4-436e-b78f-7a9221d97038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:32.335240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9010b-b3c4-436e-b78f-7a9221d97038 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:32.342655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04635ca-1e26-4d95-87e8-5e5d532696b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:32.344177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04635ca-1e26-4d95-87e8-5e5d532696b5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c04635ca-1e26-4d95-87e8-5e5d532696b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:32.359267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:32.361052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:32.362205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 377/749] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:09:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:32.362854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9b0f-798d-4416-9ce8-4ba726d14dc7 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.363302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9b0f-798d-4416-9ce8-4ba726d14dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.363302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9b0f-798d-4416-9ce8-4ba726d14dc7 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:32.370988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 378/750] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:32.375986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e9b0f-798d-4416-9ce8-4ba726d14dc7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-8ab9010b-b3c4-436e-b78f-7a9221d97038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:32.474430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:32.475519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:32.476401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:32.476401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:32.476401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:32.476401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 373/751] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 472 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:32.477304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454af9a4-785c-40e4-87e0-76947abb568f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.477592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454af9a4-785c-40e4-87e0-76947abb568f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.477861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454af9a4-785c-40e4-87e0-76947abb568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:32.499245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-454af9a4-785c-40e4-87e0-76947abb568f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:32.500449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-454af9a4-785c-40e4-87e0-76947abb568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:32.523108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e9b0f-798d-4416-9ce8-4ba726d14dc7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:32.565987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:32.567396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.567747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.568095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:32.569016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:32.569452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:32.571424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:32.593476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 374/752] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:32.594698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454af9a4-785c-40e4-87e0-76947abb568f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:32.602341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 379/753] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 21:09:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:32.608507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:32.667611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:32.740664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:32.791197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454af9a4-785c-40e4-87e0-76947abb568f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:32.839327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:32.840854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.841687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.842475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:32.844311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:32.845932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:32.848970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:32.872221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c304d-8d36-49b3-8b03-2db5b06b8825 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:32.876762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 375/754] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:32.889202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:32.991973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:32.992672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:32.992877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:32.993241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.097040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73945-c54d-4c4c-8489-f7fbffb45959 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.098022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.099574 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.138979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:33.142163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:33.154041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:33.158189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:33.158189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:33.158189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.166683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.168469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:33.183868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:33.187314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:33.188271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 376/755] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:33.189899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.244060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 380/756] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:09:33.245047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.303256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eea04-314c-4fc4-a400-e73011f43507 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.341635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:33.342731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:33.343366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:33.343847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.345555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.347284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:33.358338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:33.359412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:33.360862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:33.364662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 377/757] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:33.365937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.376208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c80d73-9b34-45a7-8c7b-ac95ba7fd9cd None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.408528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:33.418387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:33.418701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:33.418968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:33.419245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.425527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:33.425527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.425527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.441908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:33.451717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 381/758] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:33.452697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.487621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0809-2812-499e-a5a6-86cc541ff186 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.528412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:33.529463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:33.529945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:33.530534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.542898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.544968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:33.561495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:33.562483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:33.563404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:33.563404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:33.563404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:33.567198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 378/759] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:33.568342 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.590555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ff35-e4eb-449e-aa70-b51fb8914ada None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.631465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:33.632012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:33.632296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:33.632574 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.633396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:33.633706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.635199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.645491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 382/760] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:33.646541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.684216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118950e8-6ff8-43df-a36b-e70ca13b071e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.695421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:33.704598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:33.724600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:33.725110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:33.725497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:33.725891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.763386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a643968-b262-4b45-bf11-01de13712f36 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.803525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.805289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.808338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:33.809243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:33.809736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:33.810235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:33.811264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:33.811813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:33.813610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:33.832268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 383/761] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:33.833609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.935414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 379/762] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:09:33.936601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:33.956181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:33.976039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d64b7-8c56-4cd4-9327-b535a48e9081 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:33.987822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:34.037260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fde130-0ad5-46b9-b0fd-d5894670a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.038412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde130-0ad5-46b9-b0fd-d5894670a0cf None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.038412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde130-0ad5-46b9-b0fd-d5894670a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.038412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde130-0ad5-46b9-b0fd-d5894670a0cf None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.039044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde130-0ad5-46b9-b0fd-d5894670a0cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:34.039403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde130-0ad5-46b9-b0fd-d5894670a0cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.040791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde130-0ad5-46b9-b0fd-d5894670a0cf None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.051244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 384/763] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:34.052554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5acc4b-95f1-4855-b7de-4a91ad7182d9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.052883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5acc4b-95f1-4855-b7de-4a91ad7182d9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.053281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5acc4b-95f1-4855-b7de-4a91ad7182d9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.054388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 385/764] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:34.055092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5acc4b-95f1-4855-b7de-4a91ad7182d9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.090632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e371f01-05aa-46df-b094-9ff1a100fbed None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.137390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.138470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.138470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.138729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.148984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.150624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:34.164170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:34.165458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 380/765] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:34.166533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.187765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5acc4b-95f1-4855-b7de-4a91ad7182d9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.236748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87694bee-bdcc-4d46-9107-c7713be8c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.237410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694bee-bdcc-4d46-9107-c7713be8c34a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.237694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694bee-bdcc-4d46-9107-c7713be8c34a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.237971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694bee-bdcc-4d46-9107-c7713be8c34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.249302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87694bee-bdcc-4d46-9107-c7713be8c34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.250958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87694bee-bdcc-4d46-9107-c7713be8c34a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.252549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-87694bee-bdcc-4d46-9107-c7713be8c34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:34.268584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:34.270613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:34.272676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:34.272676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:34.272676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:34.272676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 386/766] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:34.272676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fd72-ae36-4a86-a6e7-f9aeb238988f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.272676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fd72-ae36-4a86-a6e7-f9aeb238988f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.272676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fd72-ae36-4a86-a6e7-f9aeb238988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.291723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-8861fd72-ae36-4a86-a6e7-f9aeb238988f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:34.291932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e205f2-59a0-4641-85d6-43cdef8e896d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.292930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8861fd72-ae36-4a86-a6e7-f9aeb238988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:34.310530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:34.327012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be1c23-9f4f-4eb9-bf64-b3ecdef82816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.327624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be1c23-9f4f-4eb9-bf64-b3ecdef82816 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.327905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be1c23-9f4f-4eb9-bf64-b3ecdef82816 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.328185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be1c23-9f4f-4eb9-bf64-b3ecdef82816 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.329435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be1c23-9f4f-4eb9-bf64-b3ecdef82816 None admin] RBAC: Adding query filter params (interface=public, service_id=9cb67c15db5a4170ac0d4a453270a7bc, region_id=RegionOne) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:34.329748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be1c23-9f4f-4eb9-bf64-b3ecdef82816 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.331297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be1c23-9f4f-4eb9-bf64-b3ecdef82816 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.338861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 381/767] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/endpoints?service_id=9cb67c15db5a4170ac0d4a453270a7bc&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:34.340058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b6fbd-8f70-4416-a2fa-db05aea5424d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.340343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b6fbd-8f70-4416-a2fa-db05aea5424d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.340617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b6fbd-8f70-4416-a2fa-db05aea5424d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.343958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 382/768] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:34.343958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b6fbd-8f70-4416-a2fa-db05aea5424d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.363250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 387/769] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:34.364176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fd72-ae36-4a86-a6e7-f9aeb238988f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.460225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b6fbd-8f70-4416-a2fa-db05aea5424d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.483337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fd72-ae36-4a86-a6e7-f9aeb238988f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.490771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:34.495983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.496665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.496947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.497252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.504790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:34.504790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.504790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.512799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 383/770] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:34.514223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.542437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0065827-764c-4e17-b33f-705529f5e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.543055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065827-764c-4e17-b33f-705529f5e024 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.543341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065827-764c-4e17-b33f-705529f5e024 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.543614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065827-764c-4e17-b33f-705529f5e024 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.544284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0065827-764c-4e17-b33f-705529f5e024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:34.544576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0065827-764c-4e17-b33f-705529f5e024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.545975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0065827-764c-4e17-b33f-705529f5e024 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.562898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 388/771] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:34.562898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190bb44-3dde-4315-af20-902e84849925 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.562898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190bb44-3dde-4315-af20-902e84849925 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.562898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190bb44-3dde-4315-af20-902e84849925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.583754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f190bb44-3dde-4315-af20-902e84849925 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:34.585594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f190bb44-3dde-4315-af20-902e84849925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:34.599833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:34.642471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492064e-b68f-45cc-b0f0-bd3fc0f629e1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.664347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 389/772] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:34.664718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190bb44-3dde-4315-af20-902e84849925 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.700873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.701540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.701815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.702082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.702688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.704600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.715812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 384/773] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:34.715812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.818855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190bb44-3dde-4315-af20-902e84849925 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.820771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:34.883161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f677-b472-40d0-8f9d-90c7074ffde6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:34.903909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.905034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.905521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.905933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.906810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=721ea6f0f684481a89a92ff264cc9d06) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:34.908291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.910259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.919010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 390/774] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/role_assignments?user.id=721ea6f0f684481a89a92ff264cc9d06&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:34.920431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:34.926247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:34.927046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:34.927333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:34.927647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:34.936306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:34.937092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:34.938697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:34.955471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:34.956657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:34.957836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:34.961169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 385/775] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:34.963585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.089087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5838d1-3bd2-441f-be76-2cfbb46f569b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:35.131337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:35.131985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:35.132263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:35.132529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] PATH_INFO: `/v3/services/network` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:35.133146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:35.134805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:35.145685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:35.147934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:35.149612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 391/776] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:35.151035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.154007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adbc9-26e8-4ca8-806e-61a50bb8ada4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:35.199984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:35.214369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:35.215364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:35.215827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:35.221344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:35.238326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:35.248363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:35.249420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:35.250377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:35.254242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 386/777] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:35.255877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.285331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:35.354046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6055728-0505-4ff3-b7d7-74510f6c441f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:35.416932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918fe12-bfb1-485f-b7cc-0b620a99be5a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:35.422763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:35.423886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:35.424170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:35.424448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:35.425193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:35.425568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:35.427029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:35.444663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 392/778] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:35.445574 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.467811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:35.468428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:35.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:35.468981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:35.469751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:35.470055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:35.471494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:35.477833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 387/779] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:35.478737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.532597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:35.611882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b6e0-2621-4347-8046-82d3721e0bb0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:35.625664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3494-4190-4604-a0d1-6ef5b579f3f1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:35.649013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:35.654444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:35.655147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:35.655494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:35.655860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:35.656611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:35.657044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:35.658827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:35.674617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 393/780] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:35.675118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:35.675918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.676128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:35.676551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:35.676971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:35.677883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=afacbc4812494825a43083cbba245e4f) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:35.678356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:35.681473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:35.690578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 388/781] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:35 2022] GET /identity/v3/role_assignments?user.id=afacbc4812494825a43083cbba245e4f&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:35.691997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.837098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dcfc8-6767-4918-81c6-de924264a318 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:35.840130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:35.885053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:35.885658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:35.885939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:35.886210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:35.910162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:35.912270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:35.933827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:35.934897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:35.935785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:35.935785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:35.935785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:35.935785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 389/782] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:35.942590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:35.971966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a076-9a3e-47ee-9802-fd8d02293ead None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:36.028831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:36.029712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:36.029990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:36.030366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:36.031158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] RBAC: Adding query filter params (type=network) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:36.031571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:36.033397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:36.040797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 394/783] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:36.050682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:36.076875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3f63-e7df-498a-a356-1c5f71e28935 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:36.125359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:36.126764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:36.127049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:36.127322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:36.127981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:36.128437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:36.129942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:36.146415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 390/784] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:36.154861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:36.197634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:36.207733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:36.282945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba46a7-f619-439e-81ff-a173fef671ec None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:36.332460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:36.334106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:36.334659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:36.335051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:36.335994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] RBAC: Adding query filter params (interface=public, service_id=222a95a9d2094a1d81c4692fa9212220, region_id=RegionOne) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:36.336579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:36.339233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:36.350726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 395/785] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:09:36 2022] GET /identity/v3/endpoints?service_id=222a95a9d2094a1d81c4692fa9212220&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:36.362537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:36.441191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018d457-cec7-4bb3-becc-edd37d7adf89 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:36.526090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:36.526732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:36.527005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:36.527268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:36.539557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:36.541158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:36.560652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:36.561758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:09:36.562774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:36.569489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 391/786] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:09:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:36.571883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c2a91-43fc-4787-94e6-ff73aa08420f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:36.572547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:36.640378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:36.674400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:36.675367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:36.675836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:36.676293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:36.676931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:36.677193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:36.678653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:36.689520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 396/787] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:09:36 2022] GET /identity/v3/services => generated 772 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:36.712792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14341458-466a-4889-8d1f-71be5dc3cf78 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:36.764391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73d360-3379-456c-a03f-7bb6aa08a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:36.765464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d360-3379-456c-a03f-7bb6aa08a120 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:36.765949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d360-3379-456c-a03f-7bb6aa08a120 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:36.766459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d360-3379-456c-a03f-7bb6aa08a120 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:36.767410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73d360-3379-456c-a03f-7bb6aa08a120 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:36.768017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73d360-3379-456c-a03f-7bb6aa08a120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:36.769754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73d360-3379-456c-a03f-7bb6aa08a120 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:36.796037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 392/788] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:09:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:36.798486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:36.985182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e5ed0-fed9-4621-86ad-d5bdf64aafea None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:37.006889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699927-9d89-4639-b1e8-3e268b0ecc2a None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.007468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699927-9d89-4639-b1e8-3e268b0ecc2a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.007967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699927-9d89-4639-b1e8-3e268b0ecc2a None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.009544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 393/789] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:09:37.015286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980ff0-29f3-4e8b-973e-02e991dd7e58 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.015607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980ff0-29f3-4e8b-973e-02e991dd7e58 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.015840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980ff0-29f3-4e8b-973e-02e991dd7e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.027191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:37.027821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.028103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.028376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.042535 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7d980ff0-29f3-4e8b-973e-02e991dd7e58 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:37.043795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7d980ff0-29f3-4e8b-973e-02e991dd7e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:37.105667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:37.129072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:37.131611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:37.172058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 394/790] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:37.262751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 397/791] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:09:37.268783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980ff0-29f3-4e8b-973e-02e991dd7e58 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:37.374563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:37.419952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980ff0-29f3-4e8b-973e-02e991dd7e58 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:37.458072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:37.458716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.458993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.459267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.471620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:37.473104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:37.491091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:37.492089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:37.492979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:37.492979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:37.492979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:37.497175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 395/792] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:37.498862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:37.506197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:37.638294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:37.658136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f478-cfe1-45b3-afd7-d9bc51bb1240 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:37.658813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2559959-a08c-4a0b-90f9-8ccc2871f98a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:37.676579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:37.698623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bbb16-be45-41c2-a702-8d6fc20c4d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:37.699294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bbb16-be45-41c2-a702-8d6fc20c4d40 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.699576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bbb16-be45-41c2-a702-8d6fc20c4d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.699850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bbb16-be45-41c2-a702-8d6fc20c4d40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.700120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:37.700456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bbb16-be45-41c2-a702-8d6fc20c4d40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:37.700960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.701372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.701791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.702006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bbb16-be45-41c2-a702-8d6fc20c4d40 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:37.702737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:37.703153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:37.705243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-181bbb16-be45-41c2-a702-8d6fc20c4d40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:37.711431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:37.712664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:37.713623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 396/793] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 29 21:09:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:37.714793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114989-b348-4a63-a2f7-a969c9497839 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.714793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114989-b348-4a63-a2f7-a969c9497839 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.715047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114989-b348-4a63-a2f7-a969c9497839 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.721145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 397/794] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:37.729129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 398/795] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:37.729129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:37.730856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702fb9b-91a6-4dc9-b3ed-a94aa6e69c21 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.730856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702fb9b-91a6-4dc9-b3ed-a94aa6e69c21 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.730856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702fb9b-91a6-4dc9-b3ed-a94aa6e69c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.751037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2702fb9b-91a6-4dc9-b3ed-a94aa6e69c21 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:37.752730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2702fb9b-91a6-4dc9-b3ed-a94aa6e69c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:37.848657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 398/796] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:37.850451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702fb9b-91a6-4dc9-b3ed-a94aa6e69c21 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:37.896229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fc685-9157-4f77-9fe5-33cd3454b6fe None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:37.981492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:37.983738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:37.985177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:37.985668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:37.987003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:37.988337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:37.990444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:38.004090 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 399/797] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 21:09:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:38.027688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:38.058813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:38.087654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702fb9b-91a6-4dc9-b3ed-a94aa6e69c21 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:38.106576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:38.139345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:38.140646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.142084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.142657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.159480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:38.162086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:38.182366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:38.183777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:38.184708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:38.189704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 399/798] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:38.193805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:38.263936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4f8e-7f34-4312-bf77-a8e9720d3d0e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:38.305644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:38.306268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.306544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.306816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.307449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:38.307752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:38.309324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:38.315278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 400/799] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 21:09:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:38.315746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:38.348086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30f74-46c0-4d69-8d21-05db471e9e0f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:38.394155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4eded-cfd8-4597-88d3-a3182492fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:38.395119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4eded-cfd8-4597-88d3-a3182492fbdf None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.395705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4eded-cfd8-4597-88d3-a3182492fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.396190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4eded-cfd8-4597-88d3-a3182492fbdf None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.397111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4eded-cfd8-4597-88d3-a3182492fbdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:38.397745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4eded-cfd8-4597-88d3-a3182492fbdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:38.399350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4eded-cfd8-4597-88d3-a3182492fbdf None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:38.414000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 400/800] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:38.415263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c99171-23a8-49d3-8a3c-f88810fae7a3 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.415549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c99171-23a8-49d3-8a3c-f88810fae7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.415824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c99171-23a8-49d3-8a3c-f88810fae7a3 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.417370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 401/801] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:38.417806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c99171-23a8-49d3-8a3c-f88810fae7a3 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:38.431268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:38.456352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:38.463183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e32adc-1539-4d05-8df4-1b857395bd49 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:38.501558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:38.502211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.502494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.503623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.515160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:38.521681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:38.523209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:38.524092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:38.527735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 401/802] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:38.528635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:38.546292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c99171-23a8-49d3-8a3c-f88810fae7a3 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:38.601732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa83c25-e43c-4c8c-9a3f-b4f81e2e067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:38.602358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83c25-e43c-4c8c-9a3f-b4f81e2e067d None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.602636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83c25-e43c-4c8c-9a3f-b4f81e2e067d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.602931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83c25-e43c-4c8c-9a3f-b4f81e2e067d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.603650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa83c25-e43c-4c8c-9a3f-b4f81e2e067d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:38.605124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa83c25-e43c-4c8c-9a3f-b4f81e2e067d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:38.662298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e79c47-9a35-43a7-8b87-956d87970203 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:38.701795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:38.702394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.702611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.702880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.703607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=5546fd3a7c324d4583817707572b1245) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:38.704483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:38.706675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:38.710104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:38.718961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 402/803] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:09:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:38.729487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10642-a295-4d62-9531-afdbc911b12d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:38.729487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10642-a295-4d62-9531-afdbc911b12d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:38.729487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10642-a295-4d62-9531-afdbc911b12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:38.729800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 402/804] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:38 2022] GET /identity/v3/role_assignments?user.id=5546fd3a7c324d4583817707572b1245&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:38.729800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:38.758505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5fd10642-a295-4d62-9531-afdbc911b12d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:38.760901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5fd10642-a295-4d62-9531-afdbc911b12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:38.926486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 403/805] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:38.988904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc701a-48cb-4c4c-8042-f6ba8666f5e9 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:39.029269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:39.029887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:39.030164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:39.030434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:39.031107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:39.031412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:39.032888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:39.045343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 403/806] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:39.053322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10642-a295-4d62-9531-afdbc911b12d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:39.075774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:39.201133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10642-a295-4d62-9531-afdbc911b12d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:39.248152 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:39.268695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ca502-07b0-47f9-87c2-36bc6f92dd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:39.269453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca502-07b0-47f9-87c2-36bc6f92dd4e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:39.269734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca502-07b0-47f9-87c2-36bc6f92dd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:39.270003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca502-07b0-47f9-87c2-36bc6f92dd4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:39.281939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ca502-07b0-47f9-87c2-36bc6f92dd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:39.283592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ca502-07b0-47f9-87c2-36bc6f92dd4e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a55ca502-07b0-47f9-87c2-36bc6f92dd4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:39.307445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:39.308573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:39.309531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:39.309531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:39.309531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:39.309947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 404/807] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:39.312117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48716-5011-4d77-b7dc-348fee3c4171 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:39.312404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48716-5011-4d77-b7dc-348fee3c4171 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:39.312679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48716-5011-4d77-b7dc-348fee3c4171 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:39.320022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 405/808] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:39.325104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c48716-5011-4d77-b7dc-348fee3c4171 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:39.346024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:39.406057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb812f-1f1c-4bc2-938e-7b7414adf448 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:39.426081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:39.456429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e43f8-6399-4806-9a8f-5f8c4d8bbdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:39.457927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e43f8-6399-4806-9a8f-5f8c4d8bbdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:39.458526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e43f8-6399-4806-9a8f-5f8c4d8bbdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:39.459805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e43f8-6399-4806-9a8f-5f8c4d8bbdf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:39.480250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c48716-5011-4d77-b7dc-348fee3c4171 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:39.488252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e43f8-6399-4806-9a8f-5f8c4d8bbdf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-ba1e43f8-6399-4806-9a8f-5f8c4d8bbdf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:39.495380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:39.496379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:39.497946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 404/809] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:39.498785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb561ab-f49d-48d1-b74a-6a9f8f411db7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:39.498785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb561ab-f49d-48d1-b74a-6a9f8f411db7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:39.498917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb561ab-f49d-48d1-b74a-6a9f8f411db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:39.520930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-bfb561ab-f49d-48d1-b74a-6a9f8f411db7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:39.523051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bfb561ab-f49d-48d1-b74a-6a9f8f411db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:39.532468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:39.533504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:39.533988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:39.534459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:39.535892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:39.536447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:39.538602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:39.556173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 406/810] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:39.557497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:39.625489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 405/811] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:39.627076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb561ab-f49d-48d1-b74a-6a9f8f411db7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:39.687083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926419d-4b50-4f50-9e1e-b56a7c074fd1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:39.721965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:39.731197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:39.737854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:39.737854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:39.737854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:39.737854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:39.737854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:39.737854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:39.746174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 407/812] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:39.754399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:39.864917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:39.955993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb561ab-f49d-48d1-b74a-6a9f8f411db7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:39.993869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a67ba-25f4-413e-886f-867bc1ff9036 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.033645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.034623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.035166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.035760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.044049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.046286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:40.060349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:40.061411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:40.062325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:40.064004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.065097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.065705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.066139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 406/813] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:09:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:40.066242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.067569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.085220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.086756 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:40.107035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:40.108152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:40.109137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:40.109137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:40.109137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:40.116299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 408/814] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:40.117588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.179728 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:40.234304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf66b98-5d2d-49fd-8d47-c7cf0f97a261 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.249097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:40.258156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b50e80-07c9-418d-8f3e-528b446f3d64 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.279214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.279887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.280167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.280591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.281225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.282952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:40.300007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:40.301088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:09:40.302048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:40.305263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 407/815] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:40.306602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.311719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.312315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.312597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.312864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.314224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:40.314534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.315999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.336915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 409/816] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:40.338135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.446104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133913-51ea-4224-8c94-da39de54f8d0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.449960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:40.457600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd974c2-e91b-4add-9829-c3a89c71b208 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.492162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.492435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.492686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.492869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.493556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:40.494049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.495727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.511018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 408/817] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:40.512243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.523639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.524296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.524581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.524901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.525612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:40.525917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.527995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.540161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 410/818] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:40.540161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.589617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:40.653985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd90f4-9581-4d6d-a9a7-ddc93c16a5a0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.654199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9045a-dbc5-4f0c-8fd7-a1e77de503b1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.701205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.701722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.702368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.702686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.702962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.703834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.704369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.704839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.714990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.716602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.717338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.718239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:40.738292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:40.740153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:40.741966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:40.741966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:40.741966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:40.741966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 409/819] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:40.741966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:40.749833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:40.751701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:40.753556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:40.756478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 411/820] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:40.756478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.788685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:40.878497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:40.898478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d30b7b-584b-4b4b-bce0-ca79eef10f93 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.928585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345bdd-d88f-48b8-b6bb-58b6b9326de2 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:40.943079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.944589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.946174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.946455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.947286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] RBAC: Adding query filter params (type=network) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:40.947435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.948819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:40.960540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 410/821] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:40.960540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:40.992507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:40.993512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:40.994227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:40.995130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:40.996216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:40.996681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:40.999116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:41.014795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 412/822] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:41.016906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:41.112012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84974b3e-e557-4c1c-bfa4-eec398b36a9b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:41.124648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:41.145665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa171c99-08d5-4a1d-a612-1fcac946565f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:41.149014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:41.149913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.150195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.150469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.151204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:41.151534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:41.152978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:41.178709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 411/823] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 21:09:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:41.179658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:41.187787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95ed06-ce1d-48e9-b8bc-4c11a290c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:41.188960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95ed06-ce1d-48e9-b8bc-4c11a290c97e None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.189269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95ed06-ce1d-48e9-b8bc-4c11a290c97e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.189541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95ed06-ce1d-48e9-b8bc-4c11a290c97e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.190243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95ed06-ce1d-48e9-b8bc-4c11a290c97e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:41.191586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95ed06-ce1d-48e9-b8bc-4c11a290c97e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:41.192654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:41.290061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccaf6a-6c65-42ca-b0f8-d5f0ed2a9f26 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:41.325940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747da37-3ae7-4105-81a3-14f5836260d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:41.326570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747da37-3ae7-4105-81a3-14f5836260d3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.326848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747da37-3ae7-4105-81a3-14f5836260d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.327120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747da37-3ae7-4105-81a3-14f5836260d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.334107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747da37-3ae7-4105-81a3-14f5836260d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:41.336337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747da37-3ae7-4105-81a3-14f5836260d3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-0747da37-3ae7-4105-81a3-14f5836260d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:41.347616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:41.349474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 412/824] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33a295-1fb2-42a9-ab9c-28099b642738 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.351180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33a295-1fb2-42a9-ab9c-28099b642738 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.352327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33a295-1fb2-42a9-ab9c-28099b642738 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.352327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 413/825] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:41.352552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33a295-1fb2-42a9-ab9c-28099b642738 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:41.400786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 413/826] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:09:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:41.402123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab761d-2f94-47c1-a90d-e5db5b137952 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.402417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab761d-2f94-47c1-a90d-e5db5b137952 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.402768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab761d-2f94-47c1-a90d-e5db5b137952 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.404585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 414/827] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:41.404822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab761d-2f94-47c1-a90d-e5db5b137952 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:41.445834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:41.505190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33a295-1fb2-42a9-ab9c-28099b642738 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:41.546524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906e4d8-2ca5-4ffe-92ce-3b8bf6fd83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:41.548167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e4d8-2ca5-4ffe-92ce-3b8bf6fd83ae None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.548548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e4d8-2ca5-4ffe-92ce-3b8bf6fd83ae None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.549016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e4d8-2ca5-4ffe-92ce-3b8bf6fd83ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.567133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906e4d8-2ca5-4ffe-92ce-3b8bf6fd83ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:41.568618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906e4d8-2ca5-4ffe-92ce-3b8bf6fd83ae None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:41.573703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab761d-2f94-47c1-a90d-e5db5b137952 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2906e4d8-2ca5-4ffe-92ce-3b8bf6fd83ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:41.585568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:41.586595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:41.589511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:41.589511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:41.589511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:41.589511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 414/828] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:41.589511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9a8d-119c-467e-aa8d-ea5db6a14421 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.589511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9a8d-119c-467e-aa8d-ea5db6a14421 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.589511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9a8d-119c-467e-aa8d-ea5db6a14421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.613031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-003c9a8d-119c-467e-aa8d-ea5db6a14421 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:41.614501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-003c9a8d-119c-467e-aa8d-ea5db6a14421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:41.634186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103b0f-1dac-47ff-bd32-f82805386ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:41.634796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103b0f-1dac-47ff-bd32-f82805386ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.635074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103b0f-1dac-47ff-bd32-f82805386ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.635344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103b0f-1dac-47ff-bd32-f82805386ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.636039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103b0f-1dac-47ff-bd32-f82805386ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:41.636347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103b0f-1dac-47ff-bd32-f82805386ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:41.637826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103b0f-1dac-47ff-bd32-f82805386ac8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:41.641008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:41.658421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 415/829] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:41.658421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a76f5-f948-4acd-a3e9-781164e72435 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.658421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a76f5-f948-4acd-a3e9-781164e72435 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.658421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a76f5-f948-4acd-a3e9-781164e72435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.683781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6d3a76f5-f948-4acd-a3e9-781164e72435 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:41.686655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6d3a76f5-f948-4acd-a3e9-781164e72435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:41.711959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 415/830] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:41.712951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c9a8d-119c-467e-aa8d-ea5db6a14421 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:41.771372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 416/831] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:41.772742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a76f5-f948-4acd-a3e9-781164e72435 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:41.782628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:41.858783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c9a8d-119c-467e-aa8d-ea5db6a14421 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:41.896656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:41.897536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.897841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.898162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.898808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:41.899109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:41.900591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:41.910270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a76f5-f948-4acd-a3e9-781164e72435 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:41.912948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 416/832] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:41.918792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:41.943962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:41.957134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:41.958625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:41.959463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:41.960136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/721ea6f0f684481a89a92ff264cc9d06/roles/290a4533dad74846ae9cadca3f9000e5` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:41.983422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=721ea6f0f684481a89a92ff264cc9d06, role_id=290a4533dad74846ae9cadca3f9000e5)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:41.986797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.060228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3deba-d0b4-43e1-8467-449d6f439059 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.067851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:42.091598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 417/833] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:41 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/721ea6f0f684481a89a92ff264cc9d06/roles/290a4533dad74846ae9cadca3f9000e5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:42.092427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.100049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.100983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.101480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.101990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.112500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.114756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:42.129992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:42.131018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:42.131885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 417/834] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:42.133211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.234632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ee074-f9e9-43c7-a25e-b14ad676f80e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.282953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d012b-d8d2-43ad-851d-c19882a74b73 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.301151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.301795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.302072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.302355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.302935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.304307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:42.316045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:42.318246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:42.319861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 418/835] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:42.321403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.341004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.342626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.343484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.344217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.345871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.348673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:42.367127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:42.368238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:42.369155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:42.370106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 418/836] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 29 21:09:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:42.377347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.381266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:42.430890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:42.465037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4315-d693-43c3-959f-343af0e60eed None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.507989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.509017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.509493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.510270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.511421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:42.512063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.515394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.518729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca5cc-8758-4781-b32f-4df9bcd0943b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.533713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 419/837] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:42.534892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.571405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.572029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.572308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.572586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.573256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:42.573561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.574942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.580649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 419/838] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:42.581626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.679367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:42.682841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0717b-9a1a-4363-8010-16fc04e57b79 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.715202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:42.724611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f244c7-3e36-45c0-b10e-7095fdd7bdd5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.736605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.737459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.737743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.738037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.738682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:42.738986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.740391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.745651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 420/839] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:42.746462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.773386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5999bf-1bed-4274-bf1c-7bb13f75a413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.774622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5999bf-1bed-4274-bf1c-7bb13f75a413 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.775245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5999bf-1bed-4274-bf1c-7bb13f75a413 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.775841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5999bf-1bed-4274-bf1c-7bb13f75a413 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/afacbc4812494825a43083cbba245e4f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.779528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5999bf-1bed-4274-bf1c-7bb13f75a413 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=afacbc4812494825a43083cbba245e4f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.781914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5999bf-1bed-4274-bf1c-7bb13f75a413 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.886753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb346a3-2d3f-4216-8694-9761bf72328a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:42.923363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:42.923976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:42.924249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:42.924557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:42.925265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:42.925643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:42.927035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:42.933335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 421/840] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:42.934202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:42.958991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 420/841] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:42 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/afacbc4812494825a43083cbba245e4f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:42.988850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:43.089395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f4ec-ba7e-4065-bae0-0e4f961fe802 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:43.137421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630552b-7e4d-4632-8091-466c78ff2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:43.138105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630552b-7e4d-4632-8091-466c78ff2d08 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:43.138425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630552b-7e4d-4632-8091-466c78ff2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:43.138701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630552b-7e4d-4632-8091-466c78ff2d08 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:43.139410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630552b-7e4d-4632-8091-466c78ff2d08 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:43.139721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630552b-7e4d-4632-8091-466c78ff2d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:43.141540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630552b-7e4d-4632-8091-466c78ff2d08 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:43.147893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 422/842] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:44.257172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e08e-f67d-4214-b735-62a19dbe48f1 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:44.257693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e08e-f67d-4214-b735-62a19dbe48f1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:44.257693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e08e-f67d-4214-b735-62a19dbe48f1 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:44.259297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 421/843] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:44.265941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1c8c3-3c1f-4c2f-929e-77fcc1d21fe8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:44.266424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1c8c3-3c1f-4c2f-929e-77fcc1d21fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:44.266635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1c8c3-3c1f-4c2f-929e-77fcc1d21fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:44.285710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-bcb1c8c3-3c1f-4c2f-929e-77fcc1d21fe8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:44.286901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-bcb1c8c3-3c1f-4c2f-929e-77fcc1d21fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:44.363553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 423/844] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:44.699336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1e08e-f67d-4214-b735-62a19dbe48f1 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:44.825564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1e08e-f67d-4214-b735-62a19dbe48f1 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:44.864027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c64c-648e-46a4-9d81-3b14529a274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:44.864673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c64c-648e-46a4-9d81-3b14529a274b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:44.864950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c64c-648e-46a4-9d81-3b14529a274b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:44.865250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c64c-648e-46a4-9d81-3b14529a274b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:44.881172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1c64c-648e-46a4-9d81-3b14529a274b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-3ab1c64c-648e-46a4-9d81-3b14529a274b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:44.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:44.889034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:44.889947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 422/845] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:09:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:44.896972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1c8c3-3c1f-4c2f-929e-77fcc1d21fe8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:44.925135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:45.014064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1c8c3-3c1f-4c2f-929e-77fcc1d21fe8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:45.027103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f6cb-9d0b-40dd-82a4-cfc8874ad22c None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.027706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f6cb-9d0b-40dd-82a4-cfc8874ad22c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.028214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f6cb-9d0b-40dd-82a4-cfc8874ad22c None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.030852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 423/846] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:45.036701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de613c2f-d91a-4463-9861-d5ffc34be480 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.037288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de613c2f-d91a-4463-9861-d5ffc34be480 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.037768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de613c2f-d91a-4463-9861-d5ffc34be480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.054274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:45.054894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.055174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.055446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.056116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:45.056423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:45.057830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:45.059568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-de613c2f-d91a-4463-9861-d5ffc34be480 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:45.061034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-de613c2f-d91a-4463-9861-d5ffc34be480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:45.073563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 424/847] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:09:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:45.075415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:45.085110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:45.154387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 424/848] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:45.155824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be837f35-aaf1-4bd2-8c64-30f31587e615 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.156176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be837f35-aaf1-4bd2-8c64-30f31587e615 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.156451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be837f35-aaf1-4bd2-8c64-30f31587e615 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.158378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 425/849] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:45.165448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a00134-a665-4468-8d6b-1a9bd5b0344f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.166102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a00134-a665-4468-8d6b-1a9bd5b0344f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.166566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a00134-a665-4468-8d6b-1a9bd5b0344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.190198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b3a00134-a665-4468-8d6b-1a9bd5b0344f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:45.192337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b3a00134-a665-4468-8d6b-1a9bd5b0344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:45.202150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:45.221400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802925-15c6-44b6-8b4e-c8be4b90c19c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:45.269495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d686e7-5bbd-408c-8c43-d0fe799a804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:45.270306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d686e7-5bbd-408c-8c43-d0fe799a804e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.270688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d686e7-5bbd-408c-8c43-d0fe799a804e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.271063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d686e7-5bbd-408c-8c43-d0fe799a804e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.286244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d686e7-5bbd-408c-8c43-d0fe799a804e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:45.288069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d686e7-5bbd-408c-8c43-d0fe799a804e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:45.300475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 426/850] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-85d686e7-5bbd-408c-8c43-d0fe799a804e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:45.310317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:45.311395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:45.312411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:45.312411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:45.312411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:45.314663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 425/851] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:45.321131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a00134-a665-4468-8d6b-1a9bd5b0344f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:45.323532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638d0f3-26b6-4748-85f3-608c40fb12df None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.324279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638d0f3-26b6-4748-85f3-608c40fb12df None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.324978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638d0f3-26b6-4748-85f3-608c40fb12df None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.326713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 426/852] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:45.334738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed104e-78f5-4b9d-86ed-6a93f83f368d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.335242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed104e-78f5-4b9d-86ed-6a93f83f368d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.335624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed104e-78f5-4b9d-86ed-6a93f83f368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.357291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-02ed104e-78f5-4b9d-86ed-6a93f83f368d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:45.358665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-02ed104e-78f5-4b9d-86ed-6a93f83f368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:45.412036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:45.445654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 427/853] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:45.446300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed104e-78f5-4b9d-86ed-6a93f83f368d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:45.454536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a00134-a665-4468-8d6b-1a9bd5b0344f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:45.501115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:45.501975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.502734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.503171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.504380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:45.505126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:45.506936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:45.522728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 427/854] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:45.530752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:45.533752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:45.583265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed104e-78f5-4b9d-86ed-6a93f83f368d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:45.635536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:45.636375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.636659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.636926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.651272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:45.652752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439b75-f9a8-4484-95d2-00b65118420b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:45.657746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:45.659215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:09:45.660662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:45.661457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 428/855] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:45.662075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:45.698835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:45.699457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.699727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.700041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.702194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:45.711276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:45.712903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:45.727659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:45.728729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:45.729730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:45.733377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 428/856] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:09:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:45.735950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:45.798576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a8cfd-9f12-4c13-9be3-2006cbe32698 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:45.830460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:45.839441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:45.840058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.847112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.847112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.847112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:45.847112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:45.884588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59523-f488-4c2d-8537-e806c558567c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:45.924517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:45.925158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:45.925460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:45.925735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:45.926419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:45.926725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:45.928096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:45.944082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 429/857] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:09:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:45.944890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:45.990041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 429/858] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:09:45 2022] POST /identity/v3/services => generated 251 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:45.991023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:46.006855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:46.086764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd72f3-8650-412b-80fa-6adca4ceacfa None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:46.148520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:46.149227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:46.149507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:46.149776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:46.150729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:46.152882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:46.153543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f331bd-0aba-423f-9187-2f2f3a711326 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:46.207564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:46.208212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:46.208492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:46.208764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:46.209541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:46.209850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:46.211341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:46.234109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 430/859] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 21:09:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:46.235492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:46.284547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:46.305976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 430/860] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:09:45 2022] POST /identity/v3/services => generated 269 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:46.308073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:46.370406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57bad-d393-4043-8de3-d01481ec2cd9 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:46.427095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:46.428116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:46.428633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:46.429109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:46.445208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:46.447218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:46.467162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:46.468176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:46.469055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:46.469055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:46.469055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:46.472409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 431/861] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:46.480782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:46.497017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e9b4-7dbe-42b5-bbae-2936a7f31818 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:46.517238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:46.549907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:46.549907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:46.549907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:46.549907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:46.616326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:46.634785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f678-294e-4ab6-a61d-1fcf8c926caa None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:46.683232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:46.684837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:46.692894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:46.695228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:46.696680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:46.698304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:46.700097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:46.700614 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:46.702205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:46.716086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 432/862] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:46.723430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:46.821380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 431/863] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:46 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:09:46.824678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:46.842787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:46.871470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58a6b-201e-41c6-8851-761e81f5be09 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:46.914861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:46.915686 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:46.916064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:46.916439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:46.928333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:46.929996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:46.944016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:46.945229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:09:46.946387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:46.952418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 433/864] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:09:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:46.953520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:46.968657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:46.974483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b291-0e9e-4ed7-8f2b-5531fc1b2b70 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.022271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.023562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.024238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.025011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.041210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.044291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:47.066404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:47.067665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:47.068551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:47.068551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:47.068551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:47.075256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 432/865] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:47.076572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:47.081704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80513d13-7f11-4e7a-9d32-08d3abe8cafa None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.130951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.131613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.131994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.132374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.133366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:47.133671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.135098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.161499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 434/866] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 21:09:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:47.163546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:47.171822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:47.230613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763929d-1863-406a-856e-57833aad4e2e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.251322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:47.274669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.275513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.275921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.276339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.277324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:47.277919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.279803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.299741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 433/867] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:47.299942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08025b-4588-4b60-a80a-955a60c23689 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.301854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:47.346031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.347042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.347735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.348219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.428308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a15736-cd61-473e-9d23-834766fc082e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.439503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.441321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.458651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:47.472470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.475596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.475596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.475596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.483443 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.485469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:47.500001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:47.501624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:47.503114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:47.505204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 434/868] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:47.507972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:47.527131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:47.571669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 435/869] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:47 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:09:47.577111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:47.647227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23374-a368-422a-81aa-8409013d5bec None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.699382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.700327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.700804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.701310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.702218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:47.702749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.704419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.705471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f456d3-a631-47de-b964-6a41a2289151 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.718668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 435/870] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:47.724971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:47.752828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.753983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.754581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.755094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.773724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.776796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.787415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:47.800660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:47.802493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:47.803413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:47.803413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:47.803413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:47.805210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 436/871] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:47.812083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:47.862572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:47.873349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35ee4-0571-4290-833a-2c32e5e86d55 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:47.912467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:47.913512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:47.914012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:47.914500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:47.915499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=721ea6f0f684481a89a92ff264cc9d06) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:47.916036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:47.917964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:47.933551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 436/872] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:47 2022] GET /identity/v3/role_assignments?user.id=721ea6f0f684481a89a92ff264cc9d06&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:47.965416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e61f0-1cf5-4630-8793-c7a724f15a48 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:48.009488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04705c-17c6-49b9-814a-35ddc9bbe705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:48.010113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04705c-17c6-49b9-814a-35ddc9bbe705 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.010416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04705c-17c6-49b9-814a-35ddc9bbe705 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.010692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04705c-17c6-49b9-814a-35ddc9bbe705 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.011353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04705c-17c6-49b9-814a-35ddc9bbe705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:48.011731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04705c-17c6-49b9-814a-35ddc9bbe705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:48.013201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04705c-17c6-49b9-814a-35ddc9bbe705 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:48.027769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 437/873] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:48.033957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:48.154944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e45046-988c-4700-a994-f906023f69c8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:48.167792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:48.211132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:48.212909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.213976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.214750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.225971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:48.227389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:48.243412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:48.245324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:48.247086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:48.247963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cefcb-f1a1-4e35-96be-768f6f6e3314 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.247963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cefcb-f1a1-4e35-96be-768f6f6e3314 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.247963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cefcb-f1a1-4e35-96be-768f6f6e3314 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.248304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 437/874] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:48.248431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 438/875] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:48.254626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:48.260563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cdbd-be48-4027-b864-4e200be3f058 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.261631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cdbd-be48-4027-b864-4e200be3f058 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.263014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cdbd-be48-4027-b864-4e200be3f058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.289010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c913cdbd-be48-4027-b864-4e200be3f058 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:48.290979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c913cdbd-be48-4027-b864-4e200be3f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:48.395032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 439/876] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:48.408796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9200b-5539-4750-8a62-d28cfb9b67b2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:48.449442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2aa4d-4e67-4b42-a8c3-2b527f71db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:48.450127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2aa4d-4e67-4b42-a8c3-2b527f71db8e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.450420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2aa4d-4e67-4b42-a8c3-2b527f71db8e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.450691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2aa4d-4e67-4b42-a8c3-2b527f71db8e None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.451454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2aa4d-4e67-4b42-a8c3-2b527f71db8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:48.451763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2aa4d-4e67-4b42-a8c3-2b527f71db8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:48.453278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2aa4d-4e67-4b42-a8c3-2b527f71db8e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:48.471591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 438/877] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:48.474925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913cdbd-be48-4027-b864-4e200be3f058 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:48.489259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:48.526705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc847b6-cfdf-43f0-9aa9-c37c31e52cb0 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.527328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc847b6-cfdf-43f0-9aa9-c37c31e52cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.527894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc847b6-cfdf-43f0-9aa9-c37c31e52cb0 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.532487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 439/878] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:48.537539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1c572-fb78-4abc-a2d4-694bc016f48f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.537924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1c572-fb78-4abc-a2d4-694bc016f48f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.538279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1c572-fb78-4abc-a2d4-694bc016f48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.557779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-8fc1c572-fb78-4abc-a2d4-694bc016f48f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:48.559099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8fc1c572-fb78-4abc-a2d4-694bc016f48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:48.585790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:48.617432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913cdbd-be48-4027-b864-4e200be3f058 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:48.638259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 440/879] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:48.661172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:48.662177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.662703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.663175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.664052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=afacbc4812494825a43083cbba245e4f) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:48.664505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:48.666207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:48.674923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 440/880] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:48 2022] GET /identity/v3/role_assignments?user.id=afacbc4812494825a43083cbba245e4f&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:48.714786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1c572-fb78-4abc-a2d4-694bc016f48f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:48.879112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1c572-fb78-4abc-a2d4-694bc016f48f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:48.930389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:48.931652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:48.932250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:48.932845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:48.934018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:48.936136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:48.946015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:48.952919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:48.955170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:48.957164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:48.961451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 441/881] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:48.966864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:48.997220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:49.063313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:49.114316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3863b2-a752-42ca-a2e2-ba3d80005017 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.126356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827acdd3-9e8c-4e5a-99b1-fc40d6e1494d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.165624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.167875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.168849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.169630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.170986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.174197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.195002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:49.196248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:49.198027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:49.200136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 441/882] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 29 21:09:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:49.202069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.202512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.202959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.205048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:49.205669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.206035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:49.208113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.217521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 442/883] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:49.224358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:49.322013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:49.339330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3cac2-5c52-4fdc-a86d-93f0d1f59bd0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.340536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef010ce-e7a1-438e-8b6a-cdfc7435d907 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.381776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.382394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.382682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.382953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.383684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:49.383990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.385494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.386939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.387793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.388271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.388787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.389672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:49.390260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.391959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 443/884] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:49.392856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.401241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:49.401439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:49.404707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 442/885] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:49.412244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:49.543473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa33dc-8412-4688-8eba-1cc29d697d1a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.553318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb297-46bc-489c-9c4e-e821b392af5a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.596647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.597317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.597601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.597872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.598036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.598652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] RBAC: Adding query filter params (interface=public, service_id=74ee47ff8a7b4bba8daa6a4439afb16f, region_id=RegionOne) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:49.598962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.599106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.599528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.599868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.600339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.600676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:49.601124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.602770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.609240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 444/886] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:09:49 2022] GET /identity/v3/endpoints?service_id=74ee47ff8a7b4bba8daa6a4439afb16f&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:49.612501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:49.614950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 443/887] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:49.620966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:49.633916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:49.699525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:49.745023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeb2f7-565d-44d6-a2bd-d9406f65f11e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.751867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9f9b-8226-4467-b30e-a3ec71e5159b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.786829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7255a-8ebd-4566-b95d-6841298e77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.787877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7255a-8ebd-4566-b95d-6841298e77e7 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.788373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7255a-8ebd-4566-b95d-6841298e77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.788924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7255a-8ebd-4566-b95d-6841298e77e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.790037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7255a-8ebd-4566-b95d-6841298e77e7 None admin] RBAC: Adding query filter params (interface=public, service_id=981877e9e13c4d8e8ce69cfa3f8a55d3, region_id=RegionOne) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:49.790633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7255a-8ebd-4566-b95d-6841298e77e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.792480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7255a-8ebd-4566-b95d-6841298e77e7 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.792794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.793618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.794017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.794384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.795121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.796681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:49.804849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 445/888] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:09:49 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:09:49.805398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 444/889] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:09:49 2022] GET /identity/v3/endpoints?service_id=981877e9e13c4d8e8ce69cfa3f8a55d3&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:49.806113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:49.914877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:49.942754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683bd7-0b9d-47fb-b51a-57925d289365 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:49.993861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49b30c-1542-4956-b8a0-cd5f9e089e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:49.994490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b30c-1542-4956-b8a0-cd5f9e089e6e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:49.994772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b30c-1542-4956-b8a0-cd5f9e089e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:49.995111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b30c-1542-4956-b8a0-cd5f9e089e6e None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:49.995834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49b30c-1542-4956-b8a0-cd5f9e089e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:49.997395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49b30c-1542-4956-b8a0-cd5f9e089e6e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:50.038791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 446/890] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:09:49 2022] GET /identity/v3/services => generated 1268 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:09:50.319166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5c679-f0e3-426e-a9c3-b6d679c6e7d0 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:50.319565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5c679-f0e3-426e-a9c3-b6d679c6e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:50.319751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5c679-f0e3-426e-a9c3-b6d679c6e7d0 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:50.321401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 445/891] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:50.327488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b95b-1ace-4a6b-a9ee-f7a92a07e18b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:50.327770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b95b-1ace-4a6b-a9ee-f7a92a07e18b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:50.328044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b95b-1ace-4a6b-a9ee-f7a92a07e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:50.347805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-94d8b95b-1ace-4a6b-a9ee-f7a92a07e18b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:50.349015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-94d8b95b-1ace-4a6b-a9ee-f7a92a07e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:50.432442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 447/892] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:50.716724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5c679-f0e3-426e-a9c3-b6d679c6e7d0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:50.836519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5c679-f0e3-426e-a9c3-b6d679c6e7d0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:50.868708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:50.878569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232553-fa82-4c93-887e-ba24be2a7b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:50.879253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232553-fa82-4c93-887e-ba24be2a7b9b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:50.879534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232553-fa82-4c93-887e-ba24be2a7b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:50.879834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232553-fa82-4c93-887e-ba24be2a7b9b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:50.891512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31232553-fa82-4c93-887e-ba24be2a7b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-31232553-fa82-4c93-887e-ba24be2a7b9b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:50.896495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:50.897673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:50.898572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 446/893] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 21:09:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:50.904174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8b95b-1ace-4a6b-a9ee-f7a92a07e18b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:50.906048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412e9b-7d6e-4d6e-ade6-c854fd5735b8 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:50.906337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412e9b-7d6e-4d6e-ade6-c854fd5735b8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:50.906783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412e9b-7d6e-4d6e-ade6-c854fd5735b8 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:50.909469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 447/894] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:50.914763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840826c-a087-4a49-a0e4-f5cd5ed4a0c1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:50.915116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840826c-a087-4a49-a0e4-f5cd5ed4a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:50.915400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840826c-a087-4a49-a0e4-f5cd5ed4a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:50.936328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f840826c-a087-4a49-a0e4-f5cd5ed4a0c1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:50.937627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f840826c-a087-4a49-a0e4-f5cd5ed4a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:50.987852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:51.016948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 448/895] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:51.021635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8b95b-1ace-4a6b-a9ee-f7a92a07e18b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.065421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.066110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.066500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.066780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.067744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:51.068094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.069565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.078955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 448/896] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 21:09:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:51.084880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840826c-a087-4a49-a0e4-f5cd5ed4a0c1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.211220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840826c-a087-4a49-a0e4-f5cd5ed4a0c1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.233427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:51.251199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.251199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.251199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.251199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.261133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.262702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:51.280700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:51.281948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:51.282868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:51.282868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:51.282868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:51.282868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 449/897] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:51.289734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.348060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.402012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e2923-abb7-475a-8890-95f66d44e951 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.444517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.445161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.445528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.445803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.446538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:51.446848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.448370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.465463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:51.466769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 449/898] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:51.467739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.539297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107470b-226a-4c85-8af2-2c3849612426 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.580767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442cdb0-00c9-4f4f-a82e-2fc3b9f738b1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.601637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.602668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.603149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.603625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.604667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.607321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.618613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.619248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.619526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.619834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:51.626167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:51.629347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:09:51.631242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:51.632746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.632886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 450/899] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:51.633009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.639614 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:51.643089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:51.644202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:51.645835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 450/900] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:51.650326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.686208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:51.714872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:51.760539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21c45-e207-4814-80b2-8d683a3497b6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.774886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bb05-acae-491c-9a27-58c3df99b1df None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.800797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.801887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.802471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.803133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.803994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:51.804532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.806276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.811992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 451/901] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:51.814430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.815022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.815363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.815737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.816362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:51.816653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.818317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.818474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.843635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 451/902] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:51.845399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:51.939773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:51.944572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f9f8-55ca-48f8-b919-99b479df0fad None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.959559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8aef-cb99-465b-ba89-66287bb2a96d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:51.974360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:51.984091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad0904-81af-4c54-9941-4db3c1e2750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:51.984738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0904-81af-4c54-9941-4db3c1e2750e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.985548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0904-81af-4c54-9941-4db3c1e2750e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.985834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0904-81af-4c54-9941-4db3c1e2750e None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.986471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0904-81af-4c54-9941-4db3c1e2750e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:51.986804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0904-81af-4c54-9941-4db3c1e2750e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:51.988291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0904-81af-4c54-9941-4db3c1e2750e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:51.993616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 452/903] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:51.994962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb3b5-b1d1-4ff6-b19c-ff2f8d1273a2 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:51.995248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb3b5-b1d1-4ff6-b19c-ff2f8d1273a2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:51.995521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb3b5-b1d1-4ff6-b19c-ff2f8d1273a2 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:51.996954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 453/904] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:52.002577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f31217-8620-4b13-a664-a95b5d616114 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.002865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f31217-8620-4b13-a664-a95b5d616114 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.006396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f31217-8620-4b13-a664-a95b5d616114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.006874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a2f93-3372-4c2e-9a55-250d94650837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:52.007826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a2f93-3372-4c2e-9a55-250d94650837 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.008260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a2f93-3372-4c2e-9a55-250d94650837 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.008816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a2f93-3372-4c2e-9a55-250d94650837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.026851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e7f31217-8620-4b13-a664-a95b5d616114 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:52.029555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e7f31217-8620-4b13-a664-a95b5d616114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:52.100866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a2f93-3372-4c2e-9a55-250d94650837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:52.102381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a2f93-3372-4c2e-9a55-250d94650837 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:52.129767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 454/905] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:52.230284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 452/906] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:09:51 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:09:52.235986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f31217-8620-4b13-a664-a95b5d616114 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:52.340129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:52.346571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e98ae-658a-4802-913f-b5a2a22eda54 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.346859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e98ae-658a-4802-913f-b5a2a22eda54 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.347479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e98ae-658a-4802-913f-b5a2a22eda54 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.351340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 453/907] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:52.352192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f31217-8620-4b13-a664-a95b5d616114 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:52.360200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3b2f8-c211-4021-9505-63557b9ea611 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.360489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3b2f8-c211-4021-9505-63557b9ea611 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.360768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3b2f8-c211-4021-9505-63557b9ea611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.382542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d5d3b2f8-c211-4021-9505-63557b9ea611 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:52.384094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d5d3b2f8-c211-4021-9505-63557b9ea611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:52.396400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:52.398733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:52.399689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.400110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.400485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.414051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:52.415498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:52.432674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:52.433981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:52.434926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:52.434926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:52.434926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:52.434926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 455/908] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:52.435174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:52.465555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 454/909] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:52.470027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3b2f8-c211-4021-9505-63557b9ea611 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:52.551149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50c84-b687-402b-b206-98a14a1bee84 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:52.597429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:52.598713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.599613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.600663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.601580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:52.604310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:52.606273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3b2f8-c211-4021-9505-63557b9ea611 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:52.620881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:52.622110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:09:52.623052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:52.627226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 456/910] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:52.633263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:52.647571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:52.648740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:52.649401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.649676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.649944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.650836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:52.651354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:52.652777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:52.667578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 455/911] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:52.675174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:52.679325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:52.781132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bd8be-f83f-4f7f-b66e-0ee48e4fb09e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:52.822425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:52.823045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.823326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.823488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8dff-fc9b-40ae-947a-2dfa4e0e47f0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:52.823622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.824221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:52.824570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:52.826006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:52.831943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 457/912] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:52.832874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:52.870113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:52.870992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:52.871471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:52.871915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:52.879367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:52.881045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:52.894360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:52.895501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:52.896677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:52.898827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 456/913] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:52.899783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:52.924688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:52.972711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ecaa-2b69-4c54-a8f5-abf270653f53 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:52.974621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:53.013339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.014264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.014577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.014878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.015395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.017404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.025622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8939-1843-4f3c-9cc5-e1fe657a1a6d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:53.029364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:53.030291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:53.034394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 458/914] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 29 21:09:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:53.035375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:53.067960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.068860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.069380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.069655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.070296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:53.070603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.071977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.087167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 457/915] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 21:09:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:53.088258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:53.179081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c78e7a-28d5-4a65-8728-c260dcd5f21c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:53.224113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fe7c9-38aa-4e1c-9fec-9200f61e436d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:53.226190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.226798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.227072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.227343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.228031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:53.228335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.229821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.233412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:53.243658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 459/916] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:53.244420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:53.258790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:53.269235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.269855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.270131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.270410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.271041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:53.271343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.272757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.282143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 458/917] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:53.282143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:53.365134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312b768-3d9d-4c9b-a461-1e4d0c9b2a65 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:53.396354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82279-599c-4ff2-97e6-e86b70d24911 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:53.402912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.403452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.403731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.404001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.404664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.406055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.439011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.439546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.439827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.440111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.440823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] RBAC: Adding query filter params (role.id=0438b23103094fbe88149f51b0d80b67, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=721ea6f0f684481a89a92ff264cc9d06) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:53.441175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.442908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.448466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 459/918] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:09:53 2022] GET /identity/v3/role_assignments?user.id=721ea6f0f684481a89a92ff264cc9d06&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=0438b23103094fbe88149f51b0d80b67 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:53.449290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:53.523174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:53.524012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 460/919] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:09:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:53.590056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad2ccb-b573-48dd-b44e-d2ffb8fd0f7b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:53.644233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb8b3f-91d9-4e30-9018-1fced4ba81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.644893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb8b3f-91d9-4e30-9018-1fced4ba81c6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.645200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb8b3f-91d9-4e30-9018-1fced4ba81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.645475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb8b3f-91d9-4e30-9018-1fced4ba81c6 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.646151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb8b3f-91d9-4e30-9018-1fced4ba81c6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:53.646482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb8b3f-91d9-4e30-9018-1fced4ba81c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.647880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb8b3f-91d9-4e30-9018-1fced4ba81c6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.655353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 460/920] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:53.663078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:53.724513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:53.775334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e2f0-a6dd-4703-aa8a-4bcdc71ecc9b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:53.812181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ed142-756f-44fb-805c-c95084b1009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:53.812830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed142-756f-44fb-805c-c95084b1009f None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:53.813714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed142-756f-44fb-805c-c95084b1009f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:53.813995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed142-756f-44fb-805c-c95084b1009f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:53.814688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ed142-756f-44fb-805c-c95084b1009f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:53.816098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ed142-756f-44fb-805c-c95084b1009f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:53.953382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 461/921] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:09:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:54.070348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a568b2-7ef3-4d79-8465-7f32b2e33ec2 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:54.070885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a568b2-7ef3-4d79-8465-7f32b2e33ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:54.070885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a568b2-7ef3-4d79-8465-7f32b2e33ec2 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:54.072592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 461/922] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:54.079433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441778f-668c-4d24-9eaa-24d23d15eda9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:54.079936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441778f-668c-4d24-9eaa-24d23d15eda9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:54.080431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441778f-668c-4d24-9eaa-24d23d15eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:54.104540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2441778f-668c-4d24-9eaa-24d23d15eda9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:54.105840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2441778f-668c-4d24-9eaa-24d23d15eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:54.210083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 462/923] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:54.506578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a568b2-7ef3-4d79-8465-7f32b2e33ec2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:54.632034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a568b2-7ef3-4d79-8465-7f32b2e33ec2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:54.648279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:54.672062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d8b3e-7e83-4914-936b-caa6eeb45ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:54.672765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d8b3e-7e83-4914-936b-caa6eeb45ddd None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:54.673046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d8b3e-7e83-4914-936b-caa6eeb45ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:54.673386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d8b3e-7e83-4914-936b-caa6eeb45ddd None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:54.674064 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d8b3e-7e83-4914-936b-caa6eeb45ddd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:54.675543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d8b3e-7e83-4914-936b-caa6eeb45ddd None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:54.769274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 462/924] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:09:54 2022] POST /identity/v3/services => generated 241 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:09:55.593345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2fc16-b6ac-43e8-888c-593164f11b62 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:55.593889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2fc16-b6ac-43e8-888c-593164f11b62 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:55.594760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2fc16-b6ac-43e8-888c-593164f11b62 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:55.596544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 463/925] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:55.602134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba29dc-ac4c-42ec-8df6-8a3e37140257 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:55.602676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba29dc-ac4c-42ec-8df6-8a3e37140257 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:55.604050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01c071-30f4-4e52-b82f-30c9e7382896 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:55.604646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01c071-30f4-4e52-b82f-30c9e7382896 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:55.604646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01c071-30f4-4e52-b82f-30c9e7382896 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:55.606030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 464/926] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:55.606220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba29dc-ac4c-42ec-8df6-8a3e37140257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:55.611486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67570397-9937-427c-96ee-c7212b113319 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:55.611767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67570397-9937-427c-96ee-c7212b113319 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:55.612046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67570397-9937-427c-96ee-c7212b113319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:55.626932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-4aba29dc-ac4c-42ec-8df6-8a3e37140257 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:55.628155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4aba29dc-ac4c-42ec-8df6-8a3e37140257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:55.630824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-67570397-9937-427c-96ee-c7212b113319 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:55.632008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-67570397-9937-427c-96ee-c7212b113319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:55.667657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:55.725192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 463/927] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:55.731541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 465/928] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:56.010828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba29dc-ac4c-42ec-8df6-8a3e37140257 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.027248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67570397-9937-427c-96ee-c7212b113319 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.140606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:56.144348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba29dc-ac4c-42ec-8df6-8a3e37140257 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:56.158297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67570397-9937-427c-96ee-c7212b113319 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:56.189567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784de9f-6481-4773-93dc-17d71873ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:56.191113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784de9f-6481-4773-93dc-17d71873ba91 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.191565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784de9f-6481-4773-93dc-17d71873ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.191980 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784de9f-6481-4773-93dc-17d71873ba91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.198909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:56.199615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.205712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.205712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.205712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:56.205712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:56.206023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784de9f-6481-4773-93dc-17d71873ba91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:09:56.206109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING keystone.server.flask.common [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e784de9f-6481-4773-93dc-17d71873ba91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:09:56.209643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:56.210735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:09:56.211722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:56.214098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 464/929] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:56.216159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abf86c-3872-4ca6-b463-ec7371bfe498 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.216445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abf86c-3872-4ca6-b463-ec7371bfe498 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.216716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abf86c-3872-4ca6-b463-ec7371bfe498 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.218137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 465/930] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:56.223457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abf86c-3872-4ca6-b463-ec7371bfe498 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.281032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.sql.core [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:09:56.281032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 21:09:56.281032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [parameters: {'id': '18900e6dc2f64dada5e77edfa33dbc55', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 21:09:56.281032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-c5c81398-bcfe-4ec5-94fe-7d76291dff7f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18900e6dc2f64dada5e77edfa33dbc55.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18900e6dc2f64dada5e77edfa33dbc55. Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:09:56.299787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result.read() Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 21:09:56.301268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application yield resource Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise self.value Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application session.commit() Aug 29 21:09:56.302567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:09:56.303672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:09:56.304772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result.read() Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:09:56.305762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [parameters: {'id': '18900e6dc2f64dada5e77edfa33dbc55', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:56.306779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:56.307752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18900e6dc2f64dada5e77edfa33dbc55. Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 466/931] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Aug 29 21:09:56 2022] POST /identity/v3/projects => generated 262 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc12d2-5469-4d7e-9287-909b37c2be2b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.309032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc12d2-5469-4d7e-9287-909b37c2be2b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.310725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc12d2-5469-4d7e-9287-909b37c2be2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.333178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-82bc12d2-5469-4d7e-9287-909b37c2be2b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:56.334713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-82bc12d2-5469-4d7e-9287-909b37c2be2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:56.353764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abf86c-3872-4ca6-b463-ec7371bfe498 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:56.355283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:56.396971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:56.397704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.397986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.398266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.398955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:56.399256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:56.400667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:56.409810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 466/932] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:56.410831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.429118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 467/933] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:56.430247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc12d2-5469-4d7e-9287-909b37c2be2b None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.453575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:56.538477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c69ec-4775-43aa-a59d-69f9bd887b14 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:56.539931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc12d2-5469-4d7e-9287-909b37c2be2b None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:56.578189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:56.579232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.579777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.580265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.583730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:56.584394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.584660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.584933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.588976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:56.590729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:56.597307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:56.599279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:56.604357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:56.605559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:56.606419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:56.608787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 467/934] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:56.616058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:56.616994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:56.617911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:56.617911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:56.617911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:56.617911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 468/935] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:56.619590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.623926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.628324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:56.733810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:56.755715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cae571-01c9-4ed6-a36b-5f26629790b8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:56.771897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f94e-8218-49d1-8789-c99b9e1fdc65 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:56.802508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:56.803427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.803719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.804003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.804668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:56.805046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:56.806509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:56.818549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccedd3c-7e63-4c1e-96ed-63badd58e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:56.822159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccedd3c-7e63-4c1e-96ed-63badd58e276 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.822159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccedd3c-7e63-4c1e-96ed-63badd58e276 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.822159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccedd3c-7e63-4c1e-96ed-63badd58e276 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.822159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccedd3c-7e63-4c1e-96ed-63badd58e276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:56.822159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccedd3c-7e63-4c1e-96ed-63badd58e276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:56.822159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccedd3c-7e63-4c1e-96ed-63badd58e276 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:56.835925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 468/936] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:56.836787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.845271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 469/937] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:56.857005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f536c4-1a84-4cdc-a0b9-7abf624f5fce None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:56.857005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f536c4-1a84-4cdc-a0b9-7abf624f5fce None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:56.857005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f536c4-1a84-4cdc-a0b9-7abf624f5fce None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:56.857005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 470/938] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:56.857005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f536c4-1a84-4cdc-a0b9-7abf624f5fce None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:56.955975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:57.003667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff57a2-f909-4e9f-bc2e-e16b486537d8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.012435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f536c4-1a84-4cdc-a0b9-7abf624f5fce None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.047380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875d3b3-2504-44a0-88d0-6e95477e850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.048554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d3b3-2504-44a0-88d0-6e95477e850e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.048652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d3b3-2504-44a0-88d0-6e95477e850e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.048919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d3b3-2504-44a0-88d0-6e95477e850e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.050335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d3b3-2504-44a0-88d0-6e95477e850e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.051142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d3b3-2504-44a0-88d0-6e95477e850e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-f875d3b3-2504-44a0-88d0-6e95477e850e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:57.060781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:57.061969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:57.063334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 469/939] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:57.064162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.064261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dea5b-29e0-4d1a-9e51-0d02ff757672 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.064333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.064401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dea5b-29e0-4d1a-9e51-0d02ff757672 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.064468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.064535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dea5b-29e0-4d1a-9e51-0d02ff757672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.064611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.074928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.076482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.078093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:57.085053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2d0dea5b-29e0-4d1a-9e51-0d02ff757672 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:57.086306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2d0dea5b-29e0-4d1a-9e51-0d02ff757672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:09:57.090282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:57.091540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:57.092455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 471/940] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:09:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:57.093041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.164657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 470/941] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:57.165821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dea5b-29e0-4d1a-9e51-0d02ff757672 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.229583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb232e-0c52-4984-b778-bfbf839d4c9c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.261447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:57.275319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.303307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.303307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.303307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.303307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:57.303307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.303307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.303786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dea5b-29e0-4d1a-9e51-0d02ff757672 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.303863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 472/942] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:57.303863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.318547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.319235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.319540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.319808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.320546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:57.320847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.322465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.325423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:57.342861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 471/943] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:57.348788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.413441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3e437-234e-4f21-b6ef-92cf2005f6f3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.462397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.462758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.463014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.463287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.463926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:57.464236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.465636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.472504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 473/944] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:57.473123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.484977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738f93e-a442-4919-91d1-ba30c0751c8a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.547921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.548985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.549991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.550499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.560137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:57.568173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.570764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:09:57.595170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:57.596489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:09:57.597740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:09:57.597740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:09:57.597740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:57.599698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 472/945] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:57.605368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.654620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d2d9-6ae3-4075-b430-b38161fcabb5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.677220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:57.710622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.711643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.712128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.712632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.713529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.715162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:57.728045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:57.729203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:09:57.730307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:09:57.733095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 474/946] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:09:57.741135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.756968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a022-f89e-4715-927f-4219a6df5cea None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.805154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.805711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.806150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.806434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.807623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:57.808054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.809583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.827191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 473/947] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:57.839026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:57.863782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74966d-cccc-4bad-bac2-55f5425d9857 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:57.884146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:57.911059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:57.911736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:57.912014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:57.912289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:57.912978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:57.913365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:57.914787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:57.920142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 475/948] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:57.925914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:58.017703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbcc6f-7ad2-4a83-8a15-da76c168b97a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:58.028940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:58.059213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:58.059420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a238c-3be6-46d2-ae9a-24156d1bad0f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:58.060212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:58.060791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:58.061243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:58.069486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:58.071175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:09:58.085545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:09:58.086747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:09:58.087916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:09:58.090003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 474/949] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:09:58.095848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:58.108349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:58.109398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:58.110416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:58.111323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:58.112816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:58.113794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:58.115635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:58.129109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 476/950] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:09:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:58.129562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:58.189035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:58.237843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87955f92-0d98-4ef7-8162-8013c4eb53db None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:58.272286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40a8a-a130-4373-a1ca-0fa47952bddf None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:58.283842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:58.284569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:58.284979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:58.286014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:58.286865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:58.287273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:58.289602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:58.309375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 475/951] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:09:58.314303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:58.325603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59452be-674e-4622-b717-cea880b4900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:58.326504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59452be-674e-4622-b717-cea880b4900c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:58.326997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59452be-674e-4622-b717-cea880b4900c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:58.327466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59452be-674e-4622-b717-cea880b4900c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:58.329030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59452be-674e-4622-b717-cea880b4900c None admin] RBAC: Adding query filter params (interface=public, service_id=166e732d5b4744c783f1bb111cc15695, region_id=RegionOne) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:09:58.329567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59452be-674e-4622-b717-cea880b4900c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:58.331141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59452be-674e-4622-b717-cea880b4900c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:58.343644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 477/952] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:09:58 2022] GET /identity/v3/endpoints?service_id=166e732d5b4744c783f1bb111cc15695&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:09:58.344708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59452be-674e-4622-b717-cea880b4900c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:58.360396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:58.462981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a139c-d7af-4dec-8307-9a4f0e81d1e5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:58.491710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59452be-674e-4622-b717-cea880b4900c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:58.504414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:58.516693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa7863-2623-4ea8-934b-c57b7062ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:58.517696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa7863-2623-4ea8-934b-c57b7062ca03 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:58.517989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa7863-2623-4ea8-934b-c57b7062ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:58.518267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa7863-2623-4ea8-934b-c57b7062ca03 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/721ea6f0f684481a89a92ff264cc9d06/roles/0438b23103094fbe88149f51b0d80b67` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:58.521037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa7863-2623-4ea8-934b-c57b7062ca03 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=721ea6f0f684481a89a92ff264cc9d06, role_id=0438b23103094fbe88149f51b0d80b67)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:58.522632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa7863-2623-4ea8-934b-c57b7062ca03 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:58.549193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f00245-8cc8-4988-8c53-8cc41a1834bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:58.549811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00245-8cc8-4988-8c53-8cc41a1834bc None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:58.550089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00245-8cc8-4988-8c53-8cc41a1834bc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:58.550360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00245-8cc8-4988-8c53-8cc41a1834bc None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:58.550965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f00245-8cc8-4988-8c53-8cc41a1834bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:58.552376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f00245-8cc8-4988-8c53-8cc41a1834bc None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:09:58.565182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 478/953] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:09:58 2022] GET /identity/v3/services => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:09:58.676826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 476/954] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:09:58 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/721ea6f0f684481a89a92ff264cc9d06/roles/0438b23103094fbe88149f51b0d80b67 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:09:59.106419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6897a-a047-41fa-b145-cdf075114d03 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:59.106970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6897a-a047-41fa-b145-cdf075114d03 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:59.106970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6897a-a047-41fa-b145-cdf075114d03 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:59.108515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 479/955] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:59.114493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e5981-cceb-4a69-b8ed-cbf04c3abe1f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:59.114781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e5981-cceb-4a69-b8ed-cbf04c3abe1f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:59.115063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e5981-cceb-4a69-b8ed-cbf04c3abe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:59.134359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a20e5981-cceb-4a69-b8ed-cbf04c3abe1f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:59.135556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a20e5981-cceb-4a69-b8ed-cbf04c3abe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:59.243675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 477/956] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:09:59.597615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b212df-86a0-4ad9-bec7-bed2d846486f None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:59.597858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b212df-86a0-4ad9-bec7-bed2d846486f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:59.598142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b212df-86a0-4ad9-bec7-bed2d846486f None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:59.599819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 480/957] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:09:59.605236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab252c-dfb3-4462-956c-2e6f74efe42d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:59.605523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab252c-dfb3-4462-956c-2e6f74efe42d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:59.605799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab252c-dfb3-4462-956c-2e6f74efe42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:59.627865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b0ab252c-dfb3-4462-956c-2e6f74efe42d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:09:59.629092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b0ab252c-dfb3-4462-956c-2e6f74efe42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:09:59.649935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:09:59.742324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 478/958] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:09:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:09:59.765031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b212df-86a0-4ad9-bec7-bed2d846486f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:09:59.897015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b212df-86a0-4ad9-bec7-bed2d846486f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:09:59.935239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:09:59.936247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:09:59.936785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:09:59.937394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:09:59.938834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:09:59.940908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:00.000886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.sql.core [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:10:00.000886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 21:10:00.000886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [parameters: {'user_id': '02ef2a1ad470426ab93be1a0a0704305', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 21:10:00.000886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result.read() Aug 29 21:10:00.009380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:10:00.010330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application yield resource Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise self.value Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application session.commit() Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:10:00.011352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:10:00.013172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:10:00.014294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application result.read() Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:10:00.015305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [parameters: {'user_id': '02ef2a1ad470426ab93be1a0a0704305', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:00.016193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 21:10:00.017022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 21:10:00.018147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 21:10:00.018147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 21:10:00.018147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:10:00.018147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:10:00.018147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 21:10:00.018147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:00.018147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 481/959] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 21:09:59 2022] POST /identity/v3/users => generated 160 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:00.022435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab252c-dfb3-4462-956c-2e6f74efe42d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:00.129082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:00.182044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:00.201165 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab252c-dfb3-4462-956c-2e6f74efe42d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:00.267898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:00.269119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:00.269403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:00.269674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:00.280092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:00.281952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c6ab9-a666-4fe9-a486-7badc947770f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:00.282093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:10:00.300398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:00.301466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:00.302442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 479/960] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:10:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:00.309053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:00.322521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:00.339033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cb7cc-c442-426a-b0fe-ca614c250fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:00.340139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb7cc-c442-426a-b0fe-ca614c250fc0 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:00.340659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb7cc-c442-426a-b0fe-ca614c250fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:00.341251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb7cc-c442-426a-b0fe-ca614c250fc0 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:00.342563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cb7cc-c442-426a-b0fe-ca614c250fc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:00.346038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cb7cc-c442-426a-b0fe-ca614c250fc0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:00.445411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6d38-317c-4bda-b605-fceadf7b89ef None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:00.480414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 482/961] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:10:00 2022] POST /identity/v3/services => generated 242 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:00.513354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca73fb-985d-44d4-abb8-b3184a613910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:00.514392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca73fb-985d-44d4-abb8-b3184a613910 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:00.514887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca73fb-985d-44d4-abb8-b3184a613910 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:00.515403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca73fb-985d-44d4-abb8-b3184a613910 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:00.516385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca73fb-985d-44d4-abb8-b3184a613910 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:00.516906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca73fb-985d-44d4-abb8-b3184a613910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:00.518940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca73fb-985d-44d4-abb8-b3184a613910 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:00.561601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 480/962] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 21:10:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:00.624571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d870-c706-4890-b280-7f97a65c1ecd None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:00.624920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d870-c706-4890-b280-7f97a65c1ecd None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:00.625152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d870-c706-4890-b280-7f97a65c1ecd None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:00.626949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 483/963] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:00.632985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e494-10a9-4761-a4ab-1f162cb93078 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:00.633854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e494-10a9-4761-a4ab-1f162cb93078 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:00.634430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e494-10a9-4761-a4ab-1f162cb93078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:00.656099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7717e494-10a9-4761-a4ab-1f162cb93078 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:00.658847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7717e494-10a9-4761-a4ab-1f162cb93078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:00.728757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:00.740941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 481/964] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:00.938831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac920-a767-4424-9daf-cea82b3c655f None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:00.939208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac920-a767-4424-9daf-cea82b3c655f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:00.939453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac920-a767-4424-9daf-cea82b3c655f None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:00.940961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 484/965] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:00.946681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91d436-c774-489b-a887-fd14c0d327e6 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:00.947187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91d436-c774-489b-a887-fd14c0d327e6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:00.947278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91d436-c774-489b-a887-fd14c0d327e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:00.971757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5a91d436-c774-489b-a887-fd14c0d327e6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:00.972931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5a91d436-c774-489b-a887-fd14c0d327e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:01.023739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfac920-a767-4424-9daf-cea82b3c655f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:01.056735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 482/966] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:01.144254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:01.155056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfac920-a767-4424-9daf-cea82b3c655f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:01.191137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:01.191781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:01.192058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:01.192329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:01.193365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:01.195204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:01.205349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:01.206714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:01.207620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 485/967] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:10:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:01.212386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91d436-c774-489b-a887-fd14c0d327e6 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:01.323663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91d436-c774-489b-a887-fd14c0d327e6 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:01.329934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:01.354657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:01.378209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:01.378899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:01.379185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:01.379510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:01.380159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:01.380493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:01.382109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:01.387542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 483/968] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:10:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:01.395534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:01.468714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b6cac-9536-4cad-a8d7-2339ec7ee7da None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:01.507558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:01.508190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:01.508667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:01.510521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:01.510618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c30e5-d220-4e9f-a703-5530873dd578 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:01.522640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:01.528114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:01.529789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:01.531338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 486/969] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 21:10:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:01.536233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:01.558116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:01.558752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:01.559038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:01.559658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:01.559967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:01.560271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:01.561697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:01.562822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:01.572951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 484/970] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:10:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:01.574879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:01.630688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:01.662836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c8ff-fd6d-4d98-8d66-0a1f79215237 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:01.685994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9ed90-9ab7-4d13-8ef4-e71c56d024dc None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:01.704305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:01.704921 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:01.705234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:01.705508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:01.706177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:01.706484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:01.707860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:01.716492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 487/971] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 21:10:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:01.722576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:01.729692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:01.730697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:01.730697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:01.730891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:01.731521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:01.732891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:01.806550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:01.827920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea5f5e-b8a2-44b8-8f19-9bca49c6df36 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:01.845131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 485/972] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:10:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:01.878022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:01.878669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:01.878973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:01.879243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:01.893244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:01.894730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:01.911731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:01.912913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:01.913982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:01.913982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:01.913982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:01.913982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 488/973] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:01.919107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:02.035469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22da0c-e340-4f1c-9e17-cb6d8d416e0f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:02.038809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:02.073520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:02.073520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:02.074048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:02.074048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:02.074658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:02.074966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:02.076336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:02.090157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 486/974] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:02.097193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:02.213562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5db9-a166-45ca-a888-43bef15026e1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:02.246338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:02.259809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:02.268668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:02.268668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:02.268668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:02.270307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:02.271780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:10:02.283815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:02.284782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:02.289972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 489/975] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:10:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:02.293657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:02.409344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48ad7-75f6-4501-a2a0-795cd8c7d1cb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:02.447899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b43c0-f249-415e-8237-7df7977779bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:02.448865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b43c0-f249-415e-8237-7df7977779bb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:02.449360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b43c0-f249-415e-8237-7df7977779bb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:02.449841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b43c0-f249-415e-8237-7df7977779bb None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:02.450866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b43c0-f249-415e-8237-7df7977779bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:02.451390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b43c0-f249-415e-8237-7df7977779bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:02.453012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b43c0-f249-415e-8237-7df7977779bb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:02.479691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 487/976] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 21:10:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:02.481278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:02.560244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a344b-0cb6-4412-84d4-02993bb97e52 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:02.560698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a344b-0cb6-4412-84d4-02993bb97e52 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:02.561203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a344b-0cb6-4412-84d4-02993bb97e52 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:02.563655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 488/977] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:02.569585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374985b0-baea-4412-a4ac-3710b3f99e80 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:02.569918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374985b0-baea-4412-a4ac-3710b3f99e80 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:02.570237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374985b0-baea-4412-a4ac-3710b3f99e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:02.589950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-374985b0-baea-4412-a4ac-3710b3f99e80 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:02.591064 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-374985b0-baea-4412-a4ac-3710b3f99e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:02.596444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a996-f97a-44ee-acfa-50d6518f753c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:02.611278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:02.637358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:02.637977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:02.638256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:02.638527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:02.669659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 489/978] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:02.699344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:02.713897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:02.715514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:02.820640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 490/979] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:02 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:10:02.826182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374985b0-baea-4412-a4ac-3710b3f99e80 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:02.943480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374985b0-baea-4412-a4ac-3710b3f99e80 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:02.946679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:02.980014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:02.980656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:02.980934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:02.981235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:02.994157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:02.995642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:03.014305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:03.015405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:03.016347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:03.016347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:03.016347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:03.016347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 490/980] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:03.021666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.024977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:03.054618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:03.071382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b190a-4dd3-4a2b-b322-6b4bce96652a None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.113433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.114206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.114413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.115040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.115646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.117358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:03.127202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:03.128354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:03.129228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 491/981] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:10:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:03.134965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.144093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef64bb-0a88-4ade-a715-bc17bbbfdfcb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.189119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.189795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.190098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.190376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.191067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:03.191394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.193082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.205837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 491/982] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:03.216107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.254003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8c35-aa8a-4b83-b5c7-25756b93d572 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.292794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:03.293091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.293602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.293881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.294176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.294813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] RBAC: Adding query filter params (name=compute) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:03.295118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.296553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.303067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 492/983] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:03.309397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.326042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:03.336805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8fe92-8a97-48b5-9996-7431fa3cc416 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.374464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.375297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.375580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.375853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.383121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.384576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:10:03.398856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:03.400294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:03.401549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 492/984] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:03.407196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.428124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65d341-21d0-44f6-a37c-234cd3b6d0af None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.468668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.469797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.469973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.470606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.471254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:03.471564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.473517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.481224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 493/985] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:03.486610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.534426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514ad4-9242-439f-90dd-9bfd051d37f0 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.561621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:03.575799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.576468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.576751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.577025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.577800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:03.578107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.579401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:03.580111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.597515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 493/986] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:03.603935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.608813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ba8e-a647-4997-8be4-049b907fa12f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.648225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.648982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.649295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.649570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.650460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] RBAC: Adding query filter params (interface=public, service_id=826fdf07554f4905970a8c15ec9dd134, region_id=RegionOne) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:03.652135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.652135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.658590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 494/987] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/endpoints?service_id=826fdf07554f4905970a8c15ec9dd134&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:03.664070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:03.727249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11a630-45e5-472e-8467-612f93f6ea1b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.767528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26f98e-75ad-4b61-a832-5f492c448ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.768251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26f98e-75ad-4b61-a832-5f492c448ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.768535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26f98e-75ad-4b61-a832-5f492c448ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.768842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26f98e-75ad-4b61-a832-5f492c448ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.769764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26f98e-75ad-4b61-a832-5f492c448ea8 None admin] RBAC: Adding query filter params (role.id=0438b23103094fbe88149f51b0d80b67, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=721ea6f0f684481a89a92ff264cc9d06) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:03.770076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26f98e-75ad-4b61-a832-5f492c448ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.771517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26f98e-75ad-4b61-a832-5f492c448ea8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.778541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 494/988] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/role_assignments?user.id=721ea6f0f684481a89a92ff264cc9d06&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=0438b23103094fbe88149f51b0d80b67 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:03.807117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d08620-a281-46db-a15a-27669506d973 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:03.839149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b62c8d-2665-4679-bcd9-2edb6757db18 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.839425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b62c8d-2665-4679-bcd9-2edb6757db18 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.839702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b62c8d-2665-4679-bcd9-2edb6757db18 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.841563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 495/989] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:10:03.850360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2da0ac-e527-454f-9b6d-d52af966976d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.850771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2da0ac-e527-454f-9b6d-d52af966976d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.851143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2da0ac-e527-454f-9b6d-d52af966976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.859312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:03.861539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:03.861823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:03.862126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:03.862740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:03.864173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:03.872055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 495/990] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:10:03 2022] GET /identity/v3/services => generated 1727 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:10:03.874188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-fe2da0ac-e527-454f-9b6d-d52af966976d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:03.875503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fe2da0ac-e527-454f-9b6d-d52af966976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:03.936983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:03.973133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 496/991] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:04.249008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:04.259291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:04.384379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1de478-fba7-4d0d-91fb-8743967236e5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:04.422877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:04.423619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:04.423900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:04.424167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:04.424763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:04.426155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:04.435534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:04.436572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:04.437477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 496/992] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:10:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:04.442989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2da0ac-e527-454f-9b6d-d52af966976d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:04.551059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2da0ac-e527-454f-9b6d-d52af966976d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:04.587488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:04.588106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:04.588382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:04.588654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:04.589343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:04.589650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:04.591055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:04.601383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 497/993] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:10:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:04.602975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:04.680572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:04.723743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66fb3-b0f4-4dad-96e6-120af80c91fb None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:04.759704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:04.760417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:04.760738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:04.761011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:04.761731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:04.762103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:04.763467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:04.770355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 497/994] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:10:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:04.776088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:04.825823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:04.910868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c7299-8252-4749-8b25-80eae31df494 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:04.960492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3720f9-2a02-4e5f-ba7a-52966fa714d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:04.961139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3720f9-2a02-4e5f-ba7a-52966fa714d8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:04.961425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3720f9-2a02-4e5f-ba7a-52966fa714d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:04.961697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3720f9-2a02-4e5f-ba7a-52966fa714d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:04.962404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3720f9-2a02-4e5f-ba7a-52966fa714d8 None admin] RBAC: Adding query filter params (interface=admin, service_id=166e732d5b4744c783f1bb111cc15695, region_id=RegionOne) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:04.962716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3720f9-2a02-4e5f-ba7a-52966fa714d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:04.964142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3720f9-2a02-4e5f-ba7a-52966fa714d8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:04.974417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 498/995] 10.222.0.50 () {56 vars in 1249 bytes} [Mon Aug 29 21:10:04 2022] GET /identity/v3/endpoints?service_id=166e732d5b4744c783f1bb111cc15695&interface=admin®ion_id=RegionOne => generated 193 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:04.975618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:05.092603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58821-7fc0-4e9a-9bf1-6c6398b18f50 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:05.128340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62009b0f-f826-4443-86d9-6dd632d63dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:05.128946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62009b0f-f826-4443-86d9-6dd632d63dad None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:05.129254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62009b0f-f826-4443-86d9-6dd632d63dad None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:05.129527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62009b0f-f826-4443-86d9-6dd632d63dad None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:05.130133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62009b0f-f826-4443-86d9-6dd632d63dad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:05.131515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62009b0f-f826-4443-86d9-6dd632d63dad None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:05.132573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:05.142357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 498/996] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:10:04 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:10:05.813452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b63abb-2e96-439c-b71d-78e9cbf7df94 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:05.814144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b63abb-2e96-439c-b71d-78e9cbf7df94 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:05.814144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b63abb-2e96-439c-b71d-78e9cbf7df94 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:05.815495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 499/997] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:05.821391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34130-1963-4e45-ab4e-4c8b526c56e9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:05.821889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34130-1963-4e45-ab4e-4c8b526c56e9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:05.821968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34130-1963-4e45-ab4e-4c8b526c56e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:05.843196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-25a34130-1963-4e45-ab4e-4c8b526c56e9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:05.844869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-25a34130-1963-4e45-ab4e-4c8b526c56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:05.855362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999f20-9ebf-4bfa-af80-bda46c86f045 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:05.855649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999f20-9ebf-4bfa-af80-bda46c86f045 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:05.855924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999f20-9ebf-4bfa-af80-bda46c86f045 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:05.857486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 500/998] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:05.863270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbf08a-9057-4774-b867-479a28a10548 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:05.863646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbf08a-9057-4774-b867-479a28a10548 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:05.863804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbf08a-9057-4774-b867-479a28a10548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:05.885424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-86cbf08a-9057-4774-b867-479a28a10548 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:05.887121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-86cbf08a-9057-4774-b867-479a28a10548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:05.936161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 499/999] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:05.962201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 501/1000] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:06.206830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a34130-1963-4e45-ab4e-4c8b526c56e9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:06.255445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbf08a-9057-4774-b867-479a28a10548 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:06.293437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:06.329140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a34130-1963-4e45-ab4e-4c8b526c56e9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:06.364244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:06.378523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:06.379625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:06.380078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:06.380461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] PATH_INFO: `/v3/services/image` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:06.381509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:06.383856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:06.386404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbf08a-9057-4774-b867-479a28a10548 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:06.396509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:06.397570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:06.398380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:06.401440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 500/1001] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 29 21:10:06 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:06.403717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:06.434202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:06.434948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:06.435234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:06.435506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:06.436265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:06.437744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:06.447560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:06.448625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:06.455007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 502/1002] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:10:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:06.455795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:06.537588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fae6a-7b39-4897-889f-0a60c5e01287 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:06.580095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:06.580708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:06.580985 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:06.581290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:06.581705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:06.582363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:06.582893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:06.584282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:06.586627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155006d-ee61-485d-9cf9-f51cf7fe0f3f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:06.589854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 501/1003] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:06.596018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:06.628112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:06.629992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:06.629992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:06.629992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:06.629992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:06.630350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:06.631658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:06.641245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 503/1004] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:10:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:06.643686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:06.670361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:06.727581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9a5f-acd6-4433-8f45-d4bb0f2ccaf4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:06.766554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:06.767525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:06.767991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:06.768418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8c42-cbaa-4c2e-9ee1-79344fba2245 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:06.768788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:06.769658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] RBAC: Adding query filter params (type=image) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:06.770162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:06.771664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:06.777031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 502/1005] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:06.814414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7ba46-96c7-4e24-98b1-6fb3f902918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:06.814970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7ba46-96c7-4e24-98b1-6fb3f902918f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:06.815228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7ba46-96c7-4e24-98b1-6fb3f902918f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:06.815504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7ba46-96c7-4e24-98b1-6fb3f902918f None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:06.816152 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7ba46-96c7-4e24-98b1-6fb3f902918f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:06.816459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7ba46-96c7-4e24-98b1-6fb3f902918f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:06.818250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7ba46-96c7-4e24-98b1-6fb3f902918f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:06.833696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 504/1006] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 21:10:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:06.835680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:06.962058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b46d3c-9248-4f7f-800a-c53889acadec None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:06.984986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:07.000744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:07.001398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:07.001674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:07.001939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:07.002621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:07.004046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:07.106549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285efa6f-1a9d-405d-9c88-748d8300dfde None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:07.106889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285efa6f-1a9d-405d-9c88-748d8300dfde None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:07.107257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285efa6f-1a9d-405d-9c88-748d8300dfde None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:07.108943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 505/1007] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:10:07.115661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0c8d-2099-4176-aa39-1be4d7d456d7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:07.115942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0c8d-2099-4176-aa39-1be4d7d456d7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:07.116223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0c8d-2099-4176-aa39-1be4d7d456d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:07.135589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-badf0c8d-2099-4176-aa39-1be4d7d456d7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:07.136792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-badf0c8d-2099-4176-aa39-1be4d7d456d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:07.161352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:07.208015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 506/1008] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:07.226768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 503/1009] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:10:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:07.479463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf0c8d-2099-4176-aa39-1be4d7d456d7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:07.592373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf0c8d-2099-4176-aa39-1be4d7d456d7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:07.640026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:07.640857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:07.641269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:07.641641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:07.642555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:07.643831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:07.653553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:07.654876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:10:07.655948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:07.658439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 507/1010] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 21:10:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:07.664352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:07.775461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b824-8b21-4fb3-9429-c14bfcf3cf36 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:07.814415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:07.815195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:07.815567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:07.815965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:07.817051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:07.817557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:07.819312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:07.825529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 504/1011] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:10:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:07.834736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:07.857367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:07.951303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253c4c-78cf-4bea-91ee-edadeb607b0a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:07.990167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3c2b3-746b-4ead-97e8-9edd0329c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:07.991217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3c2b3-746b-4ead-97e8-9edd0329c8ac None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:07.991735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3c2b3-746b-4ead-97e8-9edd0329c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:07.993009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3c2b3-746b-4ead-97e8-9edd0329c8ac None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:07.993009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3c2b3-746b-4ead-97e8-9edd0329c8ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:07.993009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3c2b3-746b-4ead-97e8-9edd0329c8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:07.995813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3c2b3-746b-4ead-97e8-9edd0329c8ac None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:08.001351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 508/1012] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 21:10:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:08.007186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:08.056736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:08.134594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbf96-3d03-487a-8a02-8a2eb466c922 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:08.173185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f66362-44f5-40a2-a53f-3bcd34b00e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:08.174210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66362-44f5-40a2-a53f-3bcd34b00e02 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:08.174692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66362-44f5-40a2-a53f-3bcd34b00e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:08.175166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66362-44f5-40a2-a53f-3bcd34b00e02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:08.176070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f66362-44f5-40a2-a53f-3bcd34b00e02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:08.177666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f66362-44f5-40a2-a53f-3bcd34b00e02 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:08.281702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 505/1013] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:10:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:08.771906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7f4ad-f56b-49f9-8273-652c6ac98d28 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:08.772316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7f4ad-f56b-49f9-8273-652c6ac98d28 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:08.772445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7f4ad-f56b-49f9-8273-652c6ac98d28 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:08.773971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 509/1014] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:08.780440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b2430-8610-4e7a-b7b0-18bda8c968e5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:08.781037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b2430-8610-4e7a-b7b0-18bda8c968e5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:08.781574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b2430-8610-4e7a-b7b0-18bda8c968e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:08.804899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b23b2430-8610-4e7a-b7b0-18bda8c968e5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:08.806292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b23b2430-8610-4e7a-b7b0-18bda8c968e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:08.893111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 506/1015] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:08 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:09.166509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7f4ad-f56b-49f9-8273-652c6ac98d28 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:09.256454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:09.286177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7f4ad-f56b-49f9-8273-652c6ac98d28 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:09.322698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:09.323451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:09.323702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:09.323967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:09.324582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:09.326136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:09.326812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1461728-df4b-43db-9d06-d386518337ad None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:09.327257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1461728-df4b-43db-9d06-d386518337ad None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:09.327339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1461728-df4b-43db-9d06-d386518337ad None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:09.329620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 507/1016] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:10:09.335119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099461-83ad-4611-8e36-592c9164794f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:09.335402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099461-83ad-4611-8e36-592c9164794f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:09.335672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099461-83ad-4611-8e36-592c9164794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:09.354963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8c099461-83ad-4611-8e36-592c9164794f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:09.356170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8c099461-83ad-4611-8e36-592c9164794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:09.380070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:09.429258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 508/1017] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:09 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:09.456277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 510/1018] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:10:09 2022] POST /identity/v3/services => generated 242 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:09.699287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c099461-83ad-4611-8e36-592c9164794f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:09.806881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c099461-83ad-4611-8e36-592c9164794f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:09.856338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:09.856997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:09.857292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:09.857560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:09.869456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:09.874220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:09.875118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:09.875954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 509/1019] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 21:10:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:09.882784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.000308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f8d64-d90a-4dda-88d7-2600364e52b5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.035090 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:10.035704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.035987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.036260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.036929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:10.037265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:10.038630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:10.053117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 511/1020] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 21:10:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:10.056028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.083349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:10.194697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb1560-bc62-44d0-8f64-62eeeea62e8e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.245354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be04a99-d8ce-4b56-b189-d24192e40e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:10.246045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04a99-d8ce-4b56-b189-d24192e40e4d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.246407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04a99-d8ce-4b56-b189-d24192e40e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.246705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04a99-d8ce-4b56-b189-d24192e40e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.264726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be04a99-d8ce-4b56-b189-d24192e40e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:10.266196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be04a99-d8ce-4b56-b189-d24192e40e4d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-2be04a99-d8ce-4b56-b189-d24192e40e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:10.281622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:10.282643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:10.283587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:10.283587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:10.283587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:10.287651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 510/1021] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:10.289173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.292529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916d98-534e-4242-b16d-0141de1781d4 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.292810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916d98-534e-4242-b16d-0141de1781d4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.293360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:10.297528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916d98-534e-4242-b16d-0141de1781d4 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.299014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 511/1022] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:10.304504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e26619-51e6-4fd5-bad7-3bcfbb2e2e0c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.304786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e26619-51e6-4fd5-bad7-3bcfbb2e2e0c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.305056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e26619-51e6-4fd5-bad7-3bcfbb2e2e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.325570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f1e26619-51e6-4fd5-bad7-3bcfbb2e2e0c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:10.326955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f1e26619-51e6-4fd5-bad7-3bcfbb2e2e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:10.392370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:10.399726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4bac-1388-4867-9294-1adaede80c9b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.401243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 512/1023] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:10.441512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:10.442136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.442408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.442933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.443979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:10.444459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:10.446122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:10.465891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 512/1024] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:10.467173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e26619-51e6-4fd5-bad7-3bcfbb2e2e0c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.574630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e26619-51e6-4fd5-bad7-3bcfbb2e2e0c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.614827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:10.615836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.616116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.616519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.624266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:10.625765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:10:10.638427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:10.639454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:10.640416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 513/1025] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:10:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:10.645734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.681097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.713997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:10.746706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:10.756776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322452b4-6e27-4561-93da-a9471dd72c12 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.793793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:10.794378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.794660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.794931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.795667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:10.795974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:10.797983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:10.799381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9de40c-f67f-4cc8-8048-0125e82213f5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.821429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 513/1026] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:10:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:10.823452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.840415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:10.840977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.841288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.841561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.842671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:10.844782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:10.846644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 514/1027] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:10.856466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:10.945868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba74286-c39d-4b4b-b499-5b5a07b66003 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.964255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e01ec-245f-405a-b093-901d2f40d740 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:10.972630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:10.984695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:10.991073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:10.991073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:10.991073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:10.991315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:11.002681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:11.003299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.003598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.003848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.004500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:11.005952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:11.058811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:11.060251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:11.151912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 515/1028] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:10:10 2022] POST /identity/v3/projects => generated 311 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:11.177982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 514/1029] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:10:11.183725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:11.309543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e002e-1e94-4b72-ae38-0038491ed480 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:11.353735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d521a-a53b-4934-b6da-de0277771074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:11.354382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d521a-a53b-4934-b6da-de0277771074 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.354646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d521a-a53b-4934-b6da-de0277771074 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.354911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d521a-a53b-4934-b6da-de0277771074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.367854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d521a-a53b-4934-b6da-de0277771074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:11.369359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d521a-a53b-4934-b6da-de0277771074 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-060d521a-a53b-4934-b6da-de0277771074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:11.385617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:11.386638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:11.387637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:11.387637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:11.387637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:11.387637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 516/1030] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:11.392977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:11.421515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:11.444357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1434-b96d-43bd-a64e-216cb6982915 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.444676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1434-b96d-43bd-a64e-216cb6982915 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.445002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1434-b96d-43bd-a64e-216cb6982915 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.446816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 517/1031] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:10:11.452180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139ecb-d518-44e4-8121-c9fb09a5b6b4 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.452475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139ecb-d518-44e4-8121-c9fb09a5b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.452749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139ecb-d518-44e4-8121-c9fb09a5b6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.472786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-77139ecb-d518-44e4-8121-c9fb09a5b6b4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:11.474071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-77139ecb-d518-44e4-8121-c9fb09a5b6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:11.501920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:11.512119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0b04-9b4f-4c73-9984-bb131a63ab2f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:11.553408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:11.554083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 518/1032] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:11.554221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.554461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.554739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.555396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:11.555706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:11.557171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:11.575292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 515/1033] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:11.577109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139ecb-d518-44e4-8121-c9fb09a5b6b4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:11.683931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139ecb-d518-44e4-8121-c9fb09a5b6b4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:11.720938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:11.721603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.721880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.722147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.729518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:11.730941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:10:11.742695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:11.743655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:11.749856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 519/1034] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:11.750415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:11.829350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:11.850173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:11.854695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:11.877244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11a66-629e-4aa7-93f2-cb5867c5f301 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:11.914510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:11.915381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.915810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.916301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.917227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:11.917809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:11.919344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:11.931653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 516/1035] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:11.937480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:11.949675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a68709-97e6-4292-abfb-4cb97e804393 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:11.987995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:11.988635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:11.988912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:11.989228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:11.989814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:11.991490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:12.001544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:12.002557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:12.003365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 520/1036] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 29 21:10:11 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:12.008949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:12.056021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535e6e-c11a-4567-8f69-67b2ce044956 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:12.108184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:12.109881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:12.110628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:12.110726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:12.110990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:12.111720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] RBAC: Adding query filter params (role.id=0438b23103094fbe88149f51b0d80b67, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=5546fd3a7c324d4583817707572b1245) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:12.112030 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:12.113571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:12.127534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 517/1037] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:11 2022] GET /identity/v3/role_assignments?user.id=5546fd3a7c324d4583817707572b1245&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=0438b23103094fbe88149f51b0d80b67 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:12.142402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74365370-6db0-43e8-a0d9-5955d33421c4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:12.185239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:12.186405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:12.186686 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:12.186955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:12.188199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] RBAC: Adding query filter params (name=image) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:12.188445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:12.190328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:12.201371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 521/1038] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:12.202829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:12.213470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:12.332699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e694-ea9f-4114-81fc-72facba545aa None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:12.368744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:12.369445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:12.369726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:12.370000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:12.370702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:12.370992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:12.372419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:12.379114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 518/1039] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:12.384962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:12.493576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82fa1b-39e2-4225-bc16-83ab2c4d1aca None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:12.529463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37642d2-fab5-4d80-916e-332d8355eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:12.530093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37642d2-fab5-4d80-916e-332d8355eca1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:12.530374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37642d2-fab5-4d80-916e-332d8355eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:12.530648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37642d2-fab5-4d80-916e-332d8355eca1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:12.531400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37642d2-fab5-4d80-916e-332d8355eca1 None admin] RBAC: Adding query filter params (interface=public, service_id=6f0f5372815e4655b0ac4ac9a2dd4410, region_id=RegionOne) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:12.531712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37642d2-fab5-4d80-916e-332d8355eca1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:12.533105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37642d2-fab5-4d80-916e-332d8355eca1 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:12.538729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 522/1040] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:10:12 2022] GET /identity/v3/endpoints?service_id=6f0f5372815e4655b0ac4ac9a2dd4410&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:12.544215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:12.623678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:12.658044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6155-4405-4f3e-b7b6-1b4af7fa80d7 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:12.695572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caa066-cce1-48ec-b991-e552b7514b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:12.696214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caa066-cce1-48ec-b991-e552b7514b83 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:12.696496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caa066-cce1-48ec-b991-e552b7514b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:12.696808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caa066-cce1-48ec-b991-e552b7514b83 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:12.697458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caa066-cce1-48ec-b991-e552b7514b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:12.698826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caa066-cce1-48ec-b991-e552b7514b83 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:12.705885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 519/1041] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:10:12 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:10:13.169392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536cbb-0eee-4405-b36e-c148b091cb16 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:13.169584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536cbb-0eee-4405-b36e-c148b091cb16 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:13.169843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536cbb-0eee-4405-b36e-c148b091cb16 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:13.171179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 523/1042] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:13.176729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604ebe-fa85-4cbf-8488-c6d0eabda39e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:13.177016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604ebe-fa85-4cbf-8488-c6d0eabda39e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:13.177325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604ebe-fa85-4cbf-8488-c6d0eabda39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:13.196132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-71604ebe-fa85-4cbf-8488-c6d0eabda39e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:13.197370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-71604ebe-fa85-4cbf-8488-c6d0eabda39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:13.273454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 520/1043] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:13.541669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3536cbb-0eee-4405-b36e-c148b091cb16 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:13.557808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:13.654939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3536cbb-0eee-4405-b36e-c148b091cb16 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:13.690860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff50a1-26d0-4bb1-aa81-422153efacc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:13.691492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff50a1-26d0-4bb1-aa81-422153efacc9 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:13.691767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff50a1-26d0-4bb1-aa81-422153efacc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:13.692034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff50a1-26d0-4bb1-aa81-422153efacc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:13.693480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff50a1-26d0-4bb1-aa81-422153efacc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:13.694906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff50a1-26d0-4bb1-aa81-422153efacc9 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:13.696649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 524/1044] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:13.702183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604ebe-fa85-4cbf-8488-c6d0eabda39e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:13.767197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:13.806710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604ebe-fa85-4cbf-8488-c6d0eabda39e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:13.854725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae236f-2688-4820-b962-6f3acddb04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:13.855356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae236f-2688-4820-b962-6f3acddb04fb None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:13.855702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae236f-2688-4820-b962-6f3acddb04fb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:13.855983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae236f-2688-4820-b962-6f3acddb04fb None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:13.856693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae236f-2688-4820-b962-6f3acddb04fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:13.858174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae236f-2688-4820-b962-6f3acddb04fb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:14.041882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 521/1045] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:10:13 2022] POST /identity/v3/users => generated 285 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:10:14.044350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5beb1-6b05-4dc2-aa11-4faa2df3b0fc None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:14.044637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5beb1-6b05-4dc2-aa11-4faa2df3b0fc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:14.044935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5beb1-6b05-4dc2-aa11-4faa2df3b0fc None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:14.046497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 525/1046] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:14.052771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263927-e790-447d-b6f5-f49748c23765 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:14.053085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263927-e790-447d-b6f5-f49748c23765 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:14.053362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263927-e790-447d-b6f5-f49748c23765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:14.074413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b4263927-e790-447d-b6f5-f49748c23765 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:14.075604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b4263927-e790-447d-b6f5-f49748c23765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:14.161124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 522/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:14.429568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5beb1-6b05-4dc2-aa11-4faa2df3b0fc None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:14.514693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:14.541560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5beb1-6b05-4dc2-aa11-4faa2df3b0fc None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:14.579935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197f20d-0a62-4c47-8b11-30a502779805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:14.579935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f20d-0a62-4c47-8b11-30a502779805 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:14.579935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f20d-0a62-4c47-8b11-30a502779805 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:14.579935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f20d-0a62-4c47-8b11-30a502779805 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:14.591425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197f20d-0a62-4c47-8b11-30a502779805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-5197f20d-0a62-4c47-8b11-30a502779805 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:14.597013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:14.598158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:14.599152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 526/1048] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 21:10:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:14.604006 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263927-e790-447d-b6f5-f49748c23765 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:14.659877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:14.697836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb8b1-2daa-4967-aff8-ae2c6a727627 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:14.698064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb8b1-2daa-4967-aff8-ae2c6a727627 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:14.698369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb8b1-2daa-4967-aff8-ae2c6a727627 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:14.700428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 527/1049] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:14.706340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d138-9dc2-4bb0-9eb5-d1eed118aad5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:14.706644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d138-9dc2-4bb0-9eb5-d1eed118aad5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:14.706891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d138-9dc2-4bb0-9eb5-d1eed118aad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:14.714379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263927-e790-447d-b6f5-f49748c23765 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:14.725445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6ce6d138-9dc2-4bb0-9eb5-d1eed118aad5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:14.726631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6ce6d138-9dc2-4bb0-9eb5-d1eed118aad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:14.749988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:14.750608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:14.750890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:14.751187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:14.751863 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:14.752168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:14.753937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:14.762723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 523/1050] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 21:10:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:14.768949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:14.808362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 528/1051] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:14.876477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b308-714e-48eb-aee5-8d72117e1310 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:14.890116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:14.911444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:14.912119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:14.912396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:14.912663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:14.923895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:14.925381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:14.939806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:14.940794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:14.946667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:14.946667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:14.946667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:14.946667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 524/1052] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:14.953149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d138-9dc2-4bb0-9eb5-d1eed118aad5 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.022014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:15.057983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d138-9dc2-4bb0-9eb5-d1eed118aad5 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.085442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.099769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.100469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.100880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.101185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.101887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:15.102235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.103624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.117363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 529/1053] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:15.123532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.215080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f0cd5-1bee-41f2-8506-23d552def442 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.258911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.259543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.259816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.260085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] PATH_INFO: `/v3/services/image` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.260699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.262095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:15.271293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:15.272910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:15.273784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 525/1054] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:15.280954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.292634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca18808-fb25-4b8a-b298-fa27b252e151 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.315438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:15.329455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:15.340422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.341042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.341357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.341625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.350506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.354625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:10:15.368213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:15.372654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:15.375555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 530/1055] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:15.376717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.416685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1c525-1f83-4072-a446-80d2edea8a35 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.455649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.456611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.456876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.457182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.457807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] RBAC: Adding query filter params (name=image) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:15.458109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.459545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.469799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 526/1056] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:15.471401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.492395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3da60d-f635-4d56-bf5a-eb550f704046 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.533858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.534468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.534741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.535005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.535739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:15.536076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.537526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.555653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 531/1057] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:15.561283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.574010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:15.584429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a533c-d6c0-4783-8468-6d5e7374ef6f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.614457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:15.623108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.623755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.624110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.624299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.624935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] RBAC: Adding query filter params (type=image) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:15.625290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.626692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.632182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 527/1058] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:15.637812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.673311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cc53f-7b18-41b1-9f7b-73221078d8fd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.712725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.713438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.713716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.713988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.727240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.728952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:15.744428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:15.745463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:15.746692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:15.746692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:15.746692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:15.746692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 532/1059] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:15.751809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.753584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce366237-1ce9-4739-9ba9-bbbac04d6c63 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.792856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.793727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.794147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.794589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.795494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.797734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.867962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:15.873666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab741301-214d-4de1-96bc-526fab6e7038 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:15.900651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 528/1060] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:10:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:10:15.916664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca763-8c58-41a4-908c-9abb2b2fa27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:15.917698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca763-8c58-41a4-908c-9abb2b2fa27d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:15.917816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca763-8c58-41a4-908c-9abb2b2fa27d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:15.918025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca763-8c58-41a4-908c-9abb2b2fa27d None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:15.918773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca763-8c58-41a4-908c-9abb2b2fa27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:15.919046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca763-8c58-41a4-908c-9abb2b2fa27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:15.920533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca763-8c58-41a4-908c-9abb2b2fa27d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:15.940284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 533/1061] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:15.941227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:15.961508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:16.074713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39b57d-098b-4052-9a0e-ee73bbf039d9 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:16.089009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ae446-5a96-47eb-b541-7fcb8c83362b None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.089381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ae446-5a96-47eb-b541-7fcb8c83362b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.089618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ae446-5a96-47eb-b541-7fcb8c83362b None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:16.090977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 534/1062] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:10:16.099633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f5b7d-b602-42f8-9188-2be6e8977f7d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.099633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f5b7d-b602-42f8-9188-2be6e8977f7d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.099633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f5b7d-b602-42f8-9188-2be6e8977f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:16.117857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-042f5b7d-b602-42f8-9188-2be6e8977f7d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:16.119132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-042f5b7d-b602-42f8-9188-2be6e8977f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:16.120029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:16.120668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.121109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.121367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:16.128591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:16.130190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:10:16.144386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:16.145356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:16.146232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 529/1063] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:16.151534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:16.201829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 535/1064] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:16.233542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:16.264524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d22b-07a9-481d-ad5d-bf0e96f70bd9 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:16.302062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:16.302671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.303001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.303250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:16.303943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:16.304249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:16.305710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:16.318857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 530/1065] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:16.325101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f5b7d-b602-42f8-9188-2be6e8977f7d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:16.411872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:16.431424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f5b7d-b602-42f8-9188-2be6e8977f7d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:16.470860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:16.471523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.471823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.472097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/5546fd3a7c324d4583817707572b1245/roles/0438b23103094fbe88149f51b0d80b67` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:16.474201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=5546fd3a7c324d4583817707572b1245, role_id=0438b23103094fbe88149f51b0d80b67)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:16.475729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:16.476042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:16.567324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 536/1066] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:10:16 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/5546fd3a7c324d4583817707572b1245/roles/0438b23103094fbe88149f51b0d80b67 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:10:16.589281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e8c35-33f4-46ba-9709-6dc8b543d0e1 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:16.625983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:16.631636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:16.632718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.633329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.633830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:16.647316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:16.653118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:16.654113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:16.655028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:16.655689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 531/1067] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:10:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:16.662868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:16.781087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7395b3f-9136-41a4-a025-0fdab659b443 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:16.817737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:16.818620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.818901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.819174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:16.819844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:16.820148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:16.821585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:16.834695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 537/1068] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:10:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:16.840796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:16.953774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e487b-674b-45cb-bf9c-3a1b1193ed96 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:16.990017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:16.990678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:16.990955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:16.991229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] PATH_INFO: `/v3/users/9c5b70d877bd40988dca670d2bda8906` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:17.005615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] RBAC: Authorizing `identity:get_user(user_id=9c5b70d877bd40988dca670d2bda8906)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:17.007090 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:17.008958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 532/1069] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:16 2022] GET /identity/v3/users/9c5b70d877bd40988dca670d2bda8906 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:17.014861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:17.019614 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:17.126533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec579-b51c-40b4-9763-39b346056d94 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:17.163623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:17.164236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:17.164517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:17.164845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:17.237109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:17.238576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:17.241524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:17.352418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 538/1070] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:10:17.354042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:17.408089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:17.460843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb34b-c939-4846-8c02-1cb7617af38c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:17.497150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12a48f-d6f9-4384-98f2-75300fec2532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:17.497361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a48f-d6f9-4384-98f2-75300fec2532 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:17.497612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a48f-d6f9-4384-98f2-75300fec2532 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:17.497795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a48f-d6f9-4384-98f2-75300fec2532 None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:17.498931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12a48f-d6f9-4384-98f2-75300fec2532 None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9ac3a4a8548bc97991451c9b3218c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:17.500456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12a48f-d6f9-4384-98f2-75300fec2532 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:17.507212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 533/1071] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:17 2022] GET /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:17.508199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:17.613687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cf836-6032-4fdf-80a5-741f7afab892 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:17.616716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:17.650722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796774f7-eed1-4a50-a9a2-cf6d60dc687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:17.651338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796774f7-eed1-4a50-a9a2-cf6d60dc687e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:17.651609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796774f7-eed1-4a50-a9a2-cf6d60dc687e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:17.651924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796774f7-eed1-4a50-a9a2-cf6d60dc687e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:17.652649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796774f7-eed1-4a50-a9a2-cf6d60dc687e None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c, user.id=9c5b70d877bd40988dca670d2bda8906) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:17.652955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796774f7-eed1-4a50-a9a2-cf6d60dc687e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:17.654419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796774f7-eed1-4a50-a9a2-cf6d60dc687e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:17.661774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 539/1072] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:17 2022] GET /identity/v3/role_assignments?user.id=9c5b70d877bd40988dca670d2bda8906&scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:17.880259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702bead-0e12-4fc8-9a16-6002de2a75ad None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:17.880776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702bead-0e12-4fc8-9a16-6002de2a75ad None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:17.880854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702bead-0e12-4fc8-9a16-6002de2a75ad None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:17.882222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 534/1073] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:17.887693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da21e1-b6a3-4fac-acde-28d4e2564df5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:17.888120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da21e1-b6a3-4fac-acde-28d4e2564df5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:17.888296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da21e1-b6a3-4fac-acde-28d4e2564df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:17.907760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b0da21e1-b6a3-4fac-acde-28d4e2564df5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:17.909025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b0da21e1-b6a3-4fac-acde-28d4e2564df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:17.983796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 540/1074] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:18.258139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702bead-0e12-4fc8-9a16-6002de2a75ad None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:18.367155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702bead-0e12-4fc8-9a16-6002de2a75ad None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:18.385997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:18.404565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:18.405278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:18.405557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:18.405830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:18.480175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:18.481673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:18.540026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fbc4-9c5b-472a-862d-0305e266a53a None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:18.540225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fbc4-9c5b-472a-862d-0305e266a53a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:18.540473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fbc4-9c5b-472a-862d-0305e266a53a None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:18.542038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 541/1075] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:10:18.546572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf835f-3804-4bd3-b63f-6e5aea5f131f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:18.546881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf835f-3804-4bd3-b63f-6e5aea5f131f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:18.547157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf835f-3804-4bd3-b63f-6e5aea5f131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:18.570492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-d5bf835f-3804-4bd3-b63f-6e5aea5f131f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:18.571696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d5bf835f-3804-4bd3-b63f-6e5aea5f131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:18.589125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 535/1076] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:10:18.595518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:18.614804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:18.654089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 542/1077] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:18.703836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2fe93-8f03-4e44-b0d6-21b46ea996bb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:18.741936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:18.742562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:18.742846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:18.743113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:18.754333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:18.755779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:18.771340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:18.772387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:18.774154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:18.774154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:18.774154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:18.777391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 536/1078] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:18.778469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf835f-3804-4bd3-b63f-6e5aea5f131f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:18.809368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:18.891184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf835f-3804-4bd3-b63f-6e5aea5f131f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:18.926271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:18.929909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:18.930529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:18.930812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:18.931082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:18.931730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:18.932032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:18.933413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:18.946415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 543/1079] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:19.008106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:19.043804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ec91-ec63-4cb4-9863-e47ff170623b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:19.083425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:19.083985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.084285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.084559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.100622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:19.106148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:19.107096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:19.108593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 537/1080] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 21:10:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:19.114211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:19.219640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:19.232694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6f1e-66e2-4825-b0e5-7c319fbfe6ea None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:19.268926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:19.269638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.269914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.270180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.270833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:19.271132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:19.272474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:19.281109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 544/1081] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 21:10:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:19.287554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:19.388864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb6630-6fcc-4532-8f1a-faa388be8da9 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:19.417769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:19.423565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173036e-7ad3-4486-a3f4-b4f0762a77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:19.424199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173036e-7ad3-4486-a3f4-b4f0762a77d4 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.427774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173036e-7ad3-4486-a3f4-b4f0762a77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.427774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173036e-7ad3-4486-a3f4-b4f0762a77d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.435711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173036e-7ad3-4486-a3f4-b4f0762a77d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:19.437179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173036e-7ad3-4486-a3f4-b4f0762a77d4 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-2173036e-7ad3-4486-a3f4-b4f0762a77d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:19.451727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:19.453557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:19.454730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:19.454730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:19.454730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:19.457431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 538/1082] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:19.459289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:19.563176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e62c0f-f02d-4e10-9c9b-f10970a92f19 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:19.580659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81825-8e95-450d-9599-542a5db98f65 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.580949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81825-8e95-450d-9599-542a5db98f65 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.581260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81825-8e95-450d-9599-542a5db98f65 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.582613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 539/1083] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:10:19.587690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48175-aaa6-497c-9a6d-aaec5eea9175 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.587975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48175-aaa6-497c-9a6d-aaec5eea9175 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.588241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48175-aaa6-497c-9a6d-aaec5eea9175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.598669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:19.599280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.599560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.599830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.600529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:19.600838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:19.602229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:19.606373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-c6f48175-aaa6-497c-9a6d-aaec5eea9175 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:19.607569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c6f48175-aaa6-497c-9a6d-aaec5eea9175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:19.614456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 545/1084] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:19.620570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:19.635000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:19.679463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 540/1085] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:10:19.726293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c7294-0617-46e6-92ff-532589e08fbd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:19.762028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:19.762659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.762939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.763216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.771260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:19.772758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:10:19.785198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:19.786307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:19.787245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 546/1086] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 21:10:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:19.792096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48175-aaa6-497c-9a6d-aaec5eea9175 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:19.896827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48175-aaa6-497c-9a6d-aaec5eea9175 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:19.911985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:19.934098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:19.934706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:19.934900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:19.935167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:19.935900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:19.936208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:19.937837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:19.955058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:19.956780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 541/1087] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 21:10:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:19.962886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.036813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.066926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e042d-da8a-47e1-99e7-62e9635b30cd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.079212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3aa766-9329-44e1-866f-e25186d153ee None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.102575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.103208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.103489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.103764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.114259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:20.114704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.115310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.115615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.115890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:20.119557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:20.120673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:20.121582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 547/1088] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:10:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:20.126791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.157287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.186761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.188140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.231652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf04f86-dbfd-4019-8387-265596b677e1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.259966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.266711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.267390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.267698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.274399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.274399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:20.274399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.274399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.279307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 548/1089] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:20.285792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.292118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 542/1090] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:10:20.298414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.371754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.392186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2e5a1-567b-4afa-a658-a3ac37a986d6 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.404116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1d58-01c5-44a4-8044-a6ce9073a61a None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.431087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.431722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.432007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.432270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] PATH_INFO: `/v3/users/9c5b70d877bd40988dca670d2bda8906` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.433439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c5b70d877bd40988dca670d2bda8906)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.435024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.436603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 549/1091] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/users/9c5b70d877bd40988dca670d2bda8906 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:20.442296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.442809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.442930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.443391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.443666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.455131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.457034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:20.473581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:20.474729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:10:20.475862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:20.475862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:10:20.475862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:20.475862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 543/1092] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:10:20.480497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.510067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.551817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b1bb3-1f58-4809-9b30-6035acaa24e7 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.588093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.588316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16adc-f2ba-42d4-ae74-c604d5722ffb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.588763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.589026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.589331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.590470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9ac3a4a8548bc97991451c9b3218c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.591898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.594121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 550/1093] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:20.600297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.612428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.624151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.626429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.626429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.626429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.626429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:20.626429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.627698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.640050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 544/1094] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:20.648693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.704004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179e60d-016e-46e0-b355-3048b9629602 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.732387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.740586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.741271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.741646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.741928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c/users/9c5b70d877bd40988dca670d2bda8906/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.744009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fa9ac3a4a8548bc97991451c9b3218c, user_id=9c5b70d877bd40988dca670d2bda8906, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.745473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.751655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1161ed-429c-429a-b6c4-db7bad232040 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.787579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.788202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.788483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.788753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.795487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.797132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:10:20.808397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:20.809453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:20.810732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 545/1095] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:20.815389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:20.860577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:20.886839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 551/1096] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:10:20 2022] PUT /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c/users/9c5b70d877bd40988dca670d2bda8906/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:10:20.921033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa763864-fe7a-4a65-9035-3d397fd498ef None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:20.960598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba985c0-7e18-43b7-8e7b-73e6296ec17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:20.961300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba985c0-7e18-43b7-8e7b-73e6296ec17f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:20.961478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba985c0-7e18-43b7-8e7b-73e6296ec17f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:20.961752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba985c0-7e18-43b7-8e7b-73e6296ec17f None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:20.962462 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba985c0-7e18-43b7-8e7b-73e6296ec17f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:20.962788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba985c0-7e18-43b7-8e7b-73e6296ec17f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:20.964346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba985c0-7e18-43b7-8e7b-73e6296ec17f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:20.978272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 546/1097] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:20.984488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:21.090602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c45f1-18f1-43a4-9864-a331b2567424 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:21.126479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb42d4-7379-48a2-a5d2-a1a801bf5e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:21.127174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb42d4-7379-48a2-a5d2-a1a801bf5e5f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:21.127421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb42d4-7379-48a2-a5d2-a1a801bf5e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:21.127688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb42d4-7379-48a2-a5d2-a1a801bf5e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:21.128417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb42d4-7379-48a2-a5d2-a1a801bf5e5f None admin] RBAC: Adding query filter params (role.id=0438b23103094fbe88149f51b0d80b67, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=5546fd3a7c324d4583817707572b1245) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:21.128720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb42d4-7379-48a2-a5d2-a1a801bf5e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:21.130177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb42d4-7379-48a2-a5d2-a1a801bf5e5f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:21.136044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 552/1098] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:20 2022] GET /identity/v3/role_assignments?user.id=5546fd3a7c324d4583817707572b1245&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=0438b23103094fbe88149f51b0d80b67 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:22.831360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ebdb-f957-49b1-af60-e4878e8b0558 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:22.831967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ebdb-f957-49b1-af60-e4878e8b0558 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:22.832060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ebdb-f957-49b1-af60-e4878e8b0558 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:22.833358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 547/1099] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:22.838767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f750c5e-1ada-46fe-b4d8-81c0352be021 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:22.839204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f750c5e-1ada-46fe-b4d8-81c0352be021 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:22.839326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f750c5e-1ada-46fe-b4d8-81c0352be021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:22.864064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9f750c5e-1ada-46fe-b4d8-81c0352be021 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:22.864064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9f750c5e-1ada-46fe-b4d8-81c0352be021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:22.909733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:22.929000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 553/1100] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:23.210764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029ebdb-f957-49b1-af60-e4878e8b0558 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:23.311753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029ebdb-f957-49b1-af60-e4878e8b0558 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:23.313862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:23.348344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:23.349298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:23.349789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:23.350335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:23.361161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:23.365955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:23.367061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:23.367898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 548/1101] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:23.373263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f750c5e-1ada-46fe-b4d8-81c0352be021 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:23.471397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f750c5e-1ada-46fe-b4d8-81c0352be021 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:23.505054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:23.505675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:23.505952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:23.506218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:23.506869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:23.507173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:23.508527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:23.517382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 554/1102] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:23.523664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:23.622152 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34fd02-c33e-4382-9b71-8d43746adf64 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:23.654922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:23.655534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:23.655807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:23.656079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] PATH_INFO: `/v3/users/9c5b70d877bd40988dca670d2bda8906` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:23.657834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] RBAC: Authorizing `identity:get_user(user_id=9c5b70d877bd40988dca670d2bda8906)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:23.659216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:23.660765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 549/1103] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:23 2022] GET /identity/v3/users/9c5b70d877bd40988dca670d2bda8906 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:23.666696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:23.714019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:23.770400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208b94c-f1e7-4bec-8468-00dcc08afa56 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:23.804569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:23.805200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:23.805540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:23.805752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:23.873751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:23.875207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:23.918781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:23.974211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 555/1104] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:10:23.980245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:24.010994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:24.079726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e847a0-9fe8-464d-9aa5-63017adb757f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:24.115025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae075a-279c-4b25-b7c8-dd6d33819a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:24.115650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae075a-279c-4b25-b7c8-dd6d33819a32 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:24.115930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae075a-279c-4b25-b7c8-dd6d33819a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:24.116232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae075a-279c-4b25-b7c8-dd6d33819a32 None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:24.117380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae075a-279c-4b25-b7c8-dd6d33819a32 None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9ac3a4a8548bc97991451c9b3218c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:24.118863 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae075a-279c-4b25-b7c8-dd6d33819a32 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:24.120605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 550/1105] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:23 2022] GET /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:24.127648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:24.230444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0eaac-5ef5-4628-b0b6-a70280f9d943 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:24.263898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef66e1c-181e-464a-b618-65bbef9ee1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:24.264490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef66e1c-181e-464a-b618-65bbef9ee1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:24.264769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef66e1c-181e-464a-b618-65bbef9ee1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:24.265041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef66e1c-181e-464a-b618-65bbef9ee1c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:24.266392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef66e1c-181e-464a-b618-65bbef9ee1c3 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c, user.id=9c5b70d877bd40988dca670d2bda8906) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:24.266695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef66e1c-181e-464a-b618-65bbef9ee1c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:24.268111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef66e1c-181e-464a-b618-65bbef9ee1c3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:24.273959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 556/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:24 2022] GET /identity/v3/role_assignments?user.id=9c5b70d877bd40988dca670d2bda8906&scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:26.208719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5008-bcab-4e80-9e22-0bb8dfea12ab None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:26.209311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5008-bcab-4e80-9e22-0bb8dfea12ab None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:26.209311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5008-bcab-4e80-9e22-0bb8dfea12ab None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:26.210585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 551/1107] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:26.215977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6472-7bae-4bd2-a768-60d0852d67bf None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:26.216392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6472-7bae-4bd2-a768-60d0852d67bf None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:26.216511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6472-7bae-4bd2-a768-60d0852d67bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:26.235751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8f3c6472-7bae-4bd2-a768-60d0852d67bf None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:26.236932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8f3c6472-7bae-4bd2-a768-60d0852d67bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:26.238909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:26.305768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 557/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:26.574923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5008-bcab-4e80-9e22-0bb8dfea12ab None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:26.679236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:26.683992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5008-bcab-4e80-9e22-0bb8dfea12ab None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:26.729887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f578d8-856a-4df8-8b84-ba8f291e23fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:26.730532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f578d8-856a-4df8-8b84-ba8f291e23fa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:26.730817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f578d8-856a-4df8-8b84-ba8f291e23fa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:26.731081 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f578d8-856a-4df8-8b84-ba8f291e23fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:26.732215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f578d8-856a-4df8-8b84-ba8f291e23fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:26.733684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f578d8-856a-4df8-8b84-ba8f291e23fa None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:26.735647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 552/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:26.741332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6472-7bae-4bd2-a768-60d0852d67bf None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:26.842599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6472-7bae-4bd2-a768-60d0852d67bf None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:26.877650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb90ed-2183-4bcb-9a66-e7a409127542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:26.878266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb90ed-2183-4bcb-9a66-e7a409127542 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:26.878544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb90ed-2183-4bcb-9a66-e7a409127542 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:26.878863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb90ed-2183-4bcb-9a66-e7a409127542 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:26.879608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb90ed-2183-4bcb-9a66-e7a409127542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:26.881049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb90ed-2183-4bcb-9a66-e7a409127542 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:26.891773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:27.104132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 558/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:10:26 2022] POST /identity/v3/users => generated 286 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:29.108336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3e9d-be10-4ac6-830f-3873d2829b4b None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:29.108848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3e9d-be10-4ac6-830f-3873d2829b4b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:29.108848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3e9d-be10-4ac6-830f-3873d2829b4b None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:29.110211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 553/1111] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:29.115695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3030a-34c4-4ef4-99d6-669bf31d2df0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:29.116112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3030a-34c4-4ef4-99d6-669bf31d2df0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:29.116251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3030a-34c4-4ef4-99d6-669bf31d2df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:29.135170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-30b3030a-34c4-4ef4-99d6-669bf31d2df0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:29.136368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-30b3030a-34c4-4ef4-99d6-669bf31d2df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:29.208954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 559/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:29.485789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad3e9d-be10-4ac6-830f-3873d2829b4b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:29.590156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad3e9d-be10-4ac6-830f-3873d2829b4b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:29.624898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:29.625552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:29.625831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:29.626102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] PATH_INFO: `/v3/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:29.627493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] RBAC: Authorizing `identity:get_role(role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:29.628843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:29.630177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 554/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:29 2022] GET /identity/v3/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:29.636170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3030a-34c4-4ef4-99d6-669bf31d2df0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:29.738399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3030a-34c4-4ef4-99d6-669bf31d2df0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:29.761171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:29.772004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:29.773935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:29.773935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:29.773935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] PATH_INFO: `/v3/users/a971be2cf1ae4afd8160c3318f891716` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:29.786651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] RBAC: Authorizing `identity:get_user(user_id=a971be2cf1ae4afd8160c3318f891716)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:29.788070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:29.789712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 560/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:29 2022] GET /identity/v3/users/a971be2cf1ae4afd8160c3318f891716 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:29.795519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:29.829740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:29.896219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d571b6f-097d-4bd4-baeb-e4a04a01f834 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:29.930550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:29.931203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:29.931472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:29.931741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:29.998420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:30.000276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:30.033048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:30.101037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 555/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:10:30.107232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:30.206545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087715-62a0-4e88-81c8-bedee67b1db0 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:30.240912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dd0f4-555a-40d3-9b13-73ee16cb2f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:30.241566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd0f4-555a-40d3-9b13-73ee16cb2f65 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:30.241840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd0f4-555a-40d3-9b13-73ee16cb2f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:30.242110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd0f4-555a-40d3-9b13-73ee16cb2f65 None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:30.243241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dd0f4-555a-40d3-9b13-73ee16cb2f65 None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9ac3a4a8548bc97991451c9b3218c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:30.244667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dd0f4-555a-40d3-9b13-73ee16cb2f65 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:30.247176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 561/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:30 2022] GET /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:30.253701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:30.354521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caca6d-c90e-4ad1-92bb-7066b3fd0ec3 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:30.388496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca024666-e4ea-4117-a3eb-a2eb40170efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:30.389106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca024666-e4ea-4117-a3eb-a2eb40170efb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:30.389384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca024666-e4ea-4117-a3eb-a2eb40170efb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:30.389649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca024666-e4ea-4117-a3eb-a2eb40170efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:30.390361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca024666-e4ea-4117-a3eb-a2eb40170efb None admin] RBAC: Adding query filter params (role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c, user.id=a971be2cf1ae4afd8160c3318f891716) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:30.391183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca024666-e4ea-4117-a3eb-a2eb40170efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:30.392599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca024666-e4ea-4117-a3eb-a2eb40170efb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:30.394474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:30.398561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 556/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:30 2022] GET /identity/v3/role_assignments?user.id=a971be2cf1ae4afd8160c3318f891716&scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:10:32.276355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d1d8-52b5-469d-bb33-dd7c00897fc0 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:32.276890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d1d8-52b5-469d-bb33-dd7c00897fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:32.276890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d1d8-52b5-469d-bb33-dd7c00897fc0 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:32.278426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 562/1118] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:32.283550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86e8b-aa44-4caf-af11-359638a15fc4 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:32.285854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86e8b-aa44-4caf-af11-359638a15fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:32.285854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86e8b-aa44-4caf-af11-359638a15fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:32.303344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5cd86e8b-aa44-4caf-af11-359638a15fc4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:32.304520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5cd86e8b-aa44-4caf-af11-359638a15fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:32.374715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 557/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:32.640290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d1d8-52b5-469d-bb33-dd7c00897fc0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:32.692446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:32.743255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d1d8-52b5-469d-bb33-dd7c00897fc0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:32.779508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:32.780199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:32.780481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:32.780754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] PATH_INFO: `/v3/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:32.782220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] RBAC: Authorizing `identity:get_role(role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:32.783590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:32.784942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 563/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:32 2022] GET /identity/v3/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:32.790836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd86e8b-aa44-4caf-af11-359638a15fc4 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:32.890674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd86e8b-aa44-4caf-af11-359638a15fc4 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:32.916119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:32.924286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:32.924956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:32.925261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:32.931891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] PATH_INFO: `/v3/users/a971be2cf1ae4afd8160c3318f891716` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:32.931891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] RBAC: Authorizing `identity:get_user(user_id=a971be2cf1ae4afd8160c3318f891716)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:32.931891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:32.931891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 558/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:32 2022] GET /identity/v3/users/a971be2cf1ae4afd8160c3318f891716 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:32.935441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:33.042339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6d48-f661-42da-a174-9fe1dc8d4fd4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:33.061200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:33.078449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cad892-907e-43bd-86f3-1f9a4a104010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:33.086711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cad892-907e-43bd-86f3-1f9a4a104010 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:33.086711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cad892-907e-43bd-86f3-1f9a4a104010 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:33.086711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cad892-907e-43bd-86f3-1f9a4a104010 None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:33.086711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cad892-907e-43bd-86f3-1f9a4a104010 None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9ac3a4a8548bc97991451c9b3218c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:33.086711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cad892-907e-43bd-86f3-1f9a4a104010 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:33.086711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 564/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:32 2022] GET /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:33.089918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:33.193219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf2ce9-dd3b-4e22-b68d-bab13ecf73a2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:33.228062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003eb6f-51c8-4695-9f1f-51220f189542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:33.228713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003eb6f-51c8-4695-9f1f-51220f189542 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:33.228991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003eb6f-51c8-4695-9f1f-51220f189542 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:33.229292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003eb6f-51c8-4695-9f1f-51220f189542 None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c/users/a971be2cf1ae4afd8160c3318f891716/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:33.231483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003eb6f-51c8-4695-9f1f-51220f189542 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fa9ac3a4a8548bc97991451c9b3218c, user_id=a971be2cf1ae4afd8160c3318f891716, role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:33.232909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003eb6f-51c8-4695-9f1f-51220f189542 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:33.327041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 559/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:10:33 2022] PUT /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c/users/a971be2cf1ae4afd8160c3318f891716/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:10:35.246740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b3827-b9b9-4ddd-8576-a8323a4a58ed None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:35.247277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b3827-b9b9-4ddd-8576-a8323a4a58ed None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:35.247277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b3827-b9b9-4ddd-8576-a8323a4a58ed None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:35.248619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 565/1124] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:35.254422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30519-9352-4e20-acb8-ed4c3de1e201 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:35.254830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30519-9352-4e20-acb8-ed4c3de1e201 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:35.254956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30519-9352-4e20-acb8-ed4c3de1e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:35.273338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-06e30519-9352-4e20-acb8-ed4c3de1e201 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:35.274516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-06e30519-9352-4e20-acb8-ed4c3de1e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:35.325617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:35.342475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 560/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:35.610645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b3827-b9b9-4ddd-8576-a8323a4a58ed None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:35.716199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b3827-b9b9-4ddd-8576-a8323a4a58ed None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:35.749076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:35.749718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:35.749993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:35.750813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] PATH_INFO: `/v3/roles/e1c8f13d66154f5fb3718082f51e6688` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:35.752206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] RBAC: Authorizing `identity:get_role(role_id=e1c8f13d66154f5fb3718082f51e6688)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:35.753651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:35.754991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 566/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:35 2022] GET /identity/v3/roles/e1c8f13d66154f5fb3718082f51e6688 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:35.761248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30519-9352-4e20-acb8-ed4c3de1e201 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:35.861632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30519-9352-4e20-acb8-ed4c3de1e201 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:35.896236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:35.896906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:35.897214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:35.897492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] PATH_INFO: `/v3/users/a971be2cf1ae4afd8160c3318f891716` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:35.898626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] RBAC: Authorizing `identity:get_user(user_id=a971be2cf1ae4afd8160c3318f891716)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:35.900067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:35.901688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 561/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:35 2022] GET /identity/v3/users/a971be2cf1ae4afd8160c3318f891716 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:35.907610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:35.962978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:36.010419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e307-1ec1-437d-b2dd-a04eb2cf6b6d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:36.043663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:36.044260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:36.044538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:36.044798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:36.111215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:36.112699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:36.167873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:36.212322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 567/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:10:36.218055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:36.274118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:36.322338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e10491-2897-4b20-9007-e02c651a0a2b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:36.357337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0302-164d-4e6b-a3f9-423ca59c9f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:36.357963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0302-164d-4e6b-a3f9-423ca59c9f4e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:36.358247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0302-164d-4e6b-a3f9-423ca59c9f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:36.358522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0302-164d-4e6b-a3f9-423ca59c9f4e None admin] PATH_INFO: `/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:36.360170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b0302-164d-4e6b-a3f9-423ca59c9f4e None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9ac3a4a8548bc97991451c9b3218c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:36.361631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b0302-164d-4e6b-a3f9-423ca59c9f4e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:36.363410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 562/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:36 2022] GET /identity/v3/projects/3fa9ac3a4a8548bc97991451c9b3218c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:36.369753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:36.468477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86310-b7f5-43b1-9e93-5dc4d3052678 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:36.502408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d040d-1828-4d53-ac99-73b6afe8d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:36.503002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d040d-1828-4d53-ac99-73b6afe8d55e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:36.503281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d040d-1828-4d53-ac99-73b6afe8d55e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:36.503552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d040d-1828-4d53-ac99-73b6afe8d55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:36.504274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d040d-1828-4d53-ac99-73b6afe8d55e None admin] RBAC: Adding query filter params (role.id=e1c8f13d66154f5fb3718082f51e6688, scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c, user.id=a971be2cf1ae4afd8160c3318f891716) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:36.504578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d040d-1828-4d53-ac99-73b6afe8d55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:36.506025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d040d-1828-4d53-ac99-73b6afe8d55e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:36.511682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 568/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:36 2022] GET /identity/v3/role_assignments?user.id=a971be2cf1ae4afd8160c3318f891716&scope.project.id=3fa9ac3a4a8548bc97991451c9b3218c&role.id=e1c8f13d66154f5fb3718082f51e6688 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:38.435172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0077d-60a5-44e5-b4a9-96d8a067d1f7 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:38.435740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0077d-60a5-44e5-b4a9-96d8a067d1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:38.435740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0077d-60a5-44e5-b4a9-96d8a067d1f7 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:38.437029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 563/1131] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:38.442549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d672-0397-4b45-bf5b-567e2bfac927 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:38.443057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d672-0397-4b45-bf5b-567e2bfac927 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:38.443166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d672-0397-4b45-bf5b-567e2bfac927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:38.461700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f3c9d672-0397-4b45-bf5b-567e2bfac927 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:38.462920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f3c9d672-0397-4b45-bf5b-567e2bfac927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:38.476911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:38.530575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 569/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:38.803732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0077d-60a5-44e5-b4a9-96d8a067d1f7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:38.911890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0077d-60a5-44e5-b4a9-96d8a067d1f7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:38.935882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:38.951722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4607c-0738-41e5-95ca-15a9718b868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:38.952341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4607c-0738-41e5-95ca-15a9718b868b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:38.952621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4607c-0738-41e5-95ca-15a9718b868b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:38.952957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4607c-0738-41e5-95ca-15a9718b868b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:38.954681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4607c-0738-41e5-95ca-15a9718b868b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:38.956232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4607c-0738-41e5-95ca-15a9718b868b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:38.957950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 564/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:38.963823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d672-0397-4b45-bf5b-567e2bfac927 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:39.063939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d672-0397-4b45-bf5b-567e2bfac927 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:39.098264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f600-2a3f-4a70-92b4-0bd717b1c293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:39.098865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f600-2a3f-4a70-92b4-0bd717b1c293 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:39.099142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f600-2a3f-4a70-92b4-0bd717b1c293 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:39.099407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f600-2a3f-4a70-92b4-0bd717b1c293 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:39.100115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3f600-2a3f-4a70-92b4-0bd717b1c293 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:39.101570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3f600-2a3f-4a70-92b4-0bd717b1c293 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:39.237035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:39.243220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 570/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:10:38 2022] POST /identity/v3/projects => generated 311 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:41.212712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09843a-eaf4-4c7a-b602-939c061ee670 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:41.213263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09843a-eaf4-4c7a-b602-939c061ee670 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:41.213263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09843a-eaf4-4c7a-b602-939c061ee670 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:41.214534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 565/1135] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:41.220521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d9d37-0a3d-4054-aa81-cfd9af823359 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:41.220944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d9d37-0a3d-4054-aa81-cfd9af823359 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:41.221055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d9d37-0a3d-4054-aa81-cfd9af823359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:41.239613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c07d9d37-0a3d-4054-aa81-cfd9af823359 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:41.240589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c07d9d37-0a3d-4054-aa81-cfd9af823359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:41.309975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 571/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:41.587867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09843a-eaf4-4c7a-b602-939c061ee670 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:41.692831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09843a-eaf4-4c7a-b602-939c061ee670 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:41.727013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633707dd-d366-45dd-8065-7289f927b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:41.727634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633707dd-d366-45dd-8065-7289f927b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:41.727915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633707dd-d366-45dd-8065-7289f927b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:41.728186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633707dd-d366-45dd-8065-7289f927b7a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:41.729360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633707dd-d366-45dd-8065-7289f927b7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:41.730796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633707dd-d366-45dd-8065-7289f927b7a5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:41.732371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 566/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:41.739032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d9d37-0a3d-4054-aa81-cfd9af823359 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:41.837269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d9d37-0a3d-4054-aa81-cfd9af823359 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:41.866272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:41.871988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ccaa-720d-4d5e-8475-5538e7cc8373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:41.872678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ccaa-720d-4d5e-8475-5538e7cc8373 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:41.872956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ccaa-720d-4d5e-8475-5538e7cc8373 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:41.873245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ccaa-720d-4d5e-8475-5538e7cc8373 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:41.873953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ccaa-720d-4d5e-8475-5538e7cc8373 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:41.876006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ccaa-720d-4d5e-8475-5538e7cc8373 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:42.053340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 572/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:10:41 2022] POST /identity/v3/users => generated 286 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:44.027646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445d01-67ea-4fc4-9ae2-29490375810f None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:44.028209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445d01-67ea-4fc4-9ae2-29490375810f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:44.028209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445d01-67ea-4fc4-9ae2-29490375810f None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:44.029523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 567/1139] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:44.034897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29250ffb-56d2-4e86-84d2-a3a69504eda8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:44.035345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29250ffb-56d2-4e86-84d2-a3a69504eda8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:44.035437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29250ffb-56d2-4e86-84d2-a3a69504eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:44.053633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-29250ffb-56d2-4e86-84d2-a3a69504eda8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:44.054826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-29250ffb-56d2-4e86-84d2-a3a69504eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:44.128449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 573/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:44.402015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445d01-67ea-4fc4-9ae2-29490375810f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:44.462757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:44.504625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445d01-67ea-4fc4-9ae2-29490375810f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:44.539520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:44.540137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:44.540418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:44.540687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:44.550749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:44.555470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:44.556653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:44.557761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 568/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:44.562726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29250ffb-56d2-4e86-84d2-a3a69504eda8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:44.661524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29250ffb-56d2-4e86-84d2-a3a69504eda8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:44.679224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:44.696792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:44.697437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:44.697716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:44.697992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:44.698656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:44.698965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:44.700331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:44.708997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 574/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:44.715044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:44.818445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78eed7-80e0-46c4-839e-9e625b699eaa None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:44.837229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:44.854485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:44.855126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:44.855406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:44.855682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] PATH_INFO: `/v3/users/eea3246041c84283a87e6b8c83a71c52` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:44.869460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] RBAC: Authorizing `identity:get_user(user_id=eea3246041c84283a87e6b8c83a71c52)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:44.870905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:44.872518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 569/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:44 2022] GET /identity/v3/users/eea3246041c84283a87e6b8c83a71c52 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:44.879014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:45.040306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e6e6a-9c61-40a4-a6fc-2d186cb26652 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:45.074969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:45.075576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:45.075854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:45.076130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:45.122285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:45.145184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:45.146631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:45.245884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 575/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:10:45.252572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:45.351851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0cd29-ebb8-420c-af1c-dcea2f095dff None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:45.393463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3f0b3-e95c-4276-9047-a6ec4a3d84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:45.394122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f0b3-e95c-4276-9047-a6ec4a3d84b6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:45.394457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f0b3-e95c-4276-9047-a6ec4a3d84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:45.394734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f0b3-e95c-4276-9047-a6ec4a3d84b6 None admin] PATH_INFO: `/v3/projects/dd0a8386dfa747d199196797a57cc9ea` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:45.395865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3f0b3-e95c-4276-9047-a6ec4a3d84b6 None admin] RBAC: Authorizing `identity:get_project(project_id=dd0a8386dfa747d199196797a57cc9ea)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:45.397419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3f0b3-e95c-4276-9047-a6ec4a3d84b6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:45.399055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 570/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:45 2022] GET /identity/v3/projects/dd0a8386dfa747d199196797a57cc9ea => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:45.405315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:45.483597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:45.504950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebba6-e18b-4347-a13d-5fdb104b25dd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:45.538354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2d5b-f894-4116-8a9f-2c800fc78c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:45.538951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2d5b-f894-4116-8a9f-2c800fc78c07 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:45.539228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2d5b-f894-4116-8a9f-2c800fc78c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:45.539499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2d5b-f894-4116-8a9f-2c800fc78c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:45.540216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2d5b-f894-4116-8a9f-2c800fc78c07 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=dd0a8386dfa747d199196797a57cc9ea, user.id=eea3246041c84283a87e6b8c83a71c52) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:45.540529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2d5b-f894-4116-8a9f-2c800fc78c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:45.541996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2d5b-f894-4116-8a9f-2c800fc78c07 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:45.547194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 576/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:45 2022] GET /identity/v3/role_assignments?user.id=eea3246041c84283a87e6b8c83a71c52&scope.project.id=dd0a8386dfa747d199196797a57cc9ea&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:47.433010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f309c-3443-494d-b157-7ac0ab77f164 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:47.433606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f309c-3443-494d-b157-7ac0ab77f164 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:47.433606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f309c-3443-494d-b157-7ac0ab77f164 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:47.434956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 571/1147] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:47.440282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3721-9e0a-4a44-a2b7-dc98b36d6889 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:47.440681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3721-9e0a-4a44-a2b7-dc98b36d6889 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:47.440776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3721-9e0a-4a44-a2b7-dc98b36d6889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:47.459406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-333b3721-9e0a-4a44-a2b7-dc98b36d6889 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:47.460584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-333b3721-9e0a-4a44-a2b7-dc98b36d6889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:47.526701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 577/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:47.790286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f309c-3443-494d-b157-7ac0ab77f164 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:47.847078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:47.902606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f309c-3443-494d-b157-7ac0ab77f164 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:47.937022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:47.937668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:47.937943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:47.938701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:47.949264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:47.954558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:47.955725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:47.956559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 572/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:10:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:47.961971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3721-9e0a-4a44-a2b7-dc98b36d6889 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:48.032975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:48.060554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3721-9e0a-4a44-a2b7-dc98b36d6889 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:48.095565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:48.096175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:48.096457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:48.096741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:48.097484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:48.097790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:48.099156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:48.107726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 578/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:48.113687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:48.215585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640545f-2a33-44cd-97d5-affc3c04e981 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:48.218240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:48.252740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:48.253390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:48.253678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:48.253952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] PATH_INFO: `/v3/users/eea3246041c84283a87e6b8c83a71c52` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:48.255098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] RBAC: Authorizing `identity:get_user(user_id=eea3246041c84283a87e6b8c83a71c52)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:48.256540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:48.258558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 573/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:48 2022] GET /identity/v3/users/eea3246041c84283a87e6b8c83a71c52 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:48.264329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:48.364869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43922-37d6-4dd6-8a7d-480c65d5c30c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:48.400158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7abe9-71d0-4078-996f-17db7aea6b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:48.400775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7abe9-71d0-4078-996f-17db7aea6b33 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:48.401051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7abe9-71d0-4078-996f-17db7aea6b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:48.401344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7abe9-71d0-4078-996f-17db7aea6b33 None admin] PATH_INFO: `/v3/projects/dd0a8386dfa747d199196797a57cc9ea` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:48.402459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7abe9-71d0-4078-996f-17db7aea6b33 None admin] RBAC: Authorizing `identity:get_project(project_id=dd0a8386dfa747d199196797a57cc9ea)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:48.403868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7abe9-71d0-4078-996f-17db7aea6b33 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:48.405521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 579/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:48 2022] GET /identity/v3/projects/dd0a8386dfa747d199196797a57cc9ea => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:48.411767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:48.512239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab789-ffdd-4672-ab8b-a295003e5383 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:48.547056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e783204-751d-4b25-9133-2193cccbf70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:48.547739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783204-751d-4b25-9133-2193cccbf70b None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:48.548089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783204-751d-4b25-9133-2193cccbf70b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:48.548322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783204-751d-4b25-9133-2193cccbf70b None admin] PATH_INFO: `/v3/projects/dd0a8386dfa747d199196797a57cc9ea/users/eea3246041c84283a87e6b8c83a71c52/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:48.550255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e783204-751d-4b25-9133-2193cccbf70b None admin] RBAC: Authorizing `identity:create_grant(project_id=dd0a8386dfa747d199196797a57cc9ea, user_id=eea3246041c84283a87e6b8c83a71c52, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:48.551675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e783204-751d-4b25-9133-2193cccbf70b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:48.668059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 574/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:10:48 2022] PUT /identity/v3/projects/dd0a8386dfa747d199196797a57cc9ea/users/eea3246041c84283a87e6b8c83a71c52/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:10:50.553392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db2073-d486-4224-ab6a-94e263b66938 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:50.554203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db2073-d486-4224-ab6a-94e263b66938 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:50.554203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db2073-d486-4224-ab6a-94e263b66938 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:50.555395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 580/1154] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:50.560842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837ff8-59fb-4d8e-8056-92c2a043b5d9 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:50.561257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837ff8-59fb-4d8e-8056-92c2a043b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:50.561420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837ff8-59fb-4d8e-8056-92c2a043b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:50.582603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-39837ff8-59fb-4d8e-8056-92c2a043b5d9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:50.583799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-39837ff8-59fb-4d8e-8056-92c2a043b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:50.609545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:50.652510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 575/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:50.923081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db2073-d486-4224-ab6a-94e263b66938 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:50.926128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:51.026472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db2073-d486-4224-ab6a-94e263b66938 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:51.060115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:51.060733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:51.061035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:51.061331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:51.072280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:10:51.077015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:51.078338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:10:51.079879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 581/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:51.086627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39837ff8-59fb-4d8e-8056-92c2a043b5d9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:51.189573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39837ff8-59fb-4d8e-8056-92c2a043b5d9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:51.224245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:51.224840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:51.225143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:51.225415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:51.226075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:51.226374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:51.227721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:51.235940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 576/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:51.242041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:51.304382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:51.343220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e09b7-5eab-4cb2-a2a9-eb95d56a70cf None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:51.377863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:51.378489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:51.378773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:51.379103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] PATH_INFO: `/v3/users/eea3246041c84283a87e6b8c83a71c52` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:51.380164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] RBAC: Authorizing `identity:get_user(user_id=eea3246041c84283a87e6b8c83a71c52)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:51.381609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:51.383184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 582/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:10:51 2022] GET /identity/v3/users/eea3246041c84283a87e6b8c83a71c52 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:51.389294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:51.421053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:51.496833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22b6dc-9a14-405f-bde1-ef12c00f8d26 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:51.532123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:51.532716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:51.532994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:51.533299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:51.602627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:51.604077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:51.630059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:51.707955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 577/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:10:51.713953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:51.817022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14993a4e-2a47-4913-ad22-53d10297b807 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:51.846204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:51.852363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47bf0c-63cc-40f1-bb63-9c8becaca03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:51.858737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47bf0c-63cc-40f1-bb63-9c8becaca03c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:51.858737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47bf0c-63cc-40f1-bb63-9c8becaca03c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:51.858737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47bf0c-63cc-40f1-bb63-9c8becaca03c None admin] PATH_INFO: `/v3/projects/dd0a8386dfa747d199196797a57cc9ea` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:51.858737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47bf0c-63cc-40f1-bb63-9c8becaca03c None admin] RBAC: Authorizing `identity:get_project(project_id=dd0a8386dfa747d199196797a57cc9ea)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:51.858737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47bf0c-63cc-40f1-bb63-9c8becaca03c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:51.858737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 583/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:10:51 2022] GET /identity/v3/projects/dd0a8386dfa747d199196797a57cc9ea => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:51.865050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:51.976534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831990cc-54ba-4897-a138-d7a91ef5531d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:52.000025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:52.011716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81354660-5d1d-422c-b94b-a1e7aee2b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:52.012317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81354660-5d1d-422c-b94b-a1e7aee2b701 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:52.012588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81354660-5d1d-422c-b94b-a1e7aee2b701 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:52.012852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81354660-5d1d-422c-b94b-a1e7aee2b701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:52.013607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81354660-5d1d-422c-b94b-a1e7aee2b701 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=dd0a8386dfa747d199196797a57cc9ea, user.id=eea3246041c84283a87e6b8c83a71c52) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:52.013908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81354660-5d1d-422c-b94b-a1e7aee2b701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:52.015318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81354660-5d1d-422c-b94b-a1e7aee2b701 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:52.021757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 578/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:10:51 2022] GET /identity/v3/role_assignments?user.id=eea3246041c84283a87e6b8c83a71c52&scope.project.id=dd0a8386dfa747d199196797a57cc9ea&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:53.959201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36835d-f773-4850-b68a-391df18ea769 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:53.959757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36835d-f773-4850-b68a-391df18ea769 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:53.959757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36835d-f773-4850-b68a-391df18ea769 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:53.961211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 584/1162] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:53.966639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eadc8-5a0f-45ef-9bf8-ac42321f4714 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:53.967027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eadc8-5a0f-45ef-9bf8-ac42321f4714 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:53.967195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eadc8-5a0f-45ef-9bf8-ac42321f4714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:53.986476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f60eadc8-5a0f-45ef-9bf8-ac42321f4714 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:53.987677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f60eadc8-5a0f-45ef-9bf8-ac42321f4714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:54.057604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 579/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:54.327186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36835d-f773-4850-b68a-391df18ea769 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:54.452156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36835d-f773-4850-b68a-391df18ea769 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:54.491650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:54.492263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:54.492539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:54.492810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:54.568373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:54.572357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:54.573973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:54.684948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 585/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:10:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:10:54.691093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eadc8-5a0f-45ef-9bf8-ac42321f4714 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:54.803076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eadc8-5a0f-45ef-9bf8-ac42321f4714 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:54.822795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:54.842794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b251a6a-d6d5-4d82-8806-72fe672120d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:54.843435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251a6a-d6d5-4d82-8806-72fe672120d8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:54.843711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251a6a-d6d5-4d82-8806-72fe672120d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:54.849650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251a6a-d6d5-4d82-8806-72fe672120d8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:54.852126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b251a6a-d6d5-4d82-8806-72fe672120d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:54.853664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b251a6a-d6d5-4d82-8806-72fe672120d8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-4b251a6a-d6d5-4d82-8806-72fe672120d8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:10:54.865682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:10:54.867579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:10:54.869271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 580/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:10:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:10:54.873079 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:54.978729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:54.984113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb8e8-a63c-4c2c-82bb-db1114ca5546 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:55.029789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e0568-8e88-4a5f-ab43-6cd1af397087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:55.030403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0568-8e88-4a5f-ab43-6cd1af397087 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:55.030690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0568-8e88-4a5f-ab43-6cd1af397087 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:55.030964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0568-8e88-4a5f-ab43-6cd1af397087 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:55.031614 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0568-8e88-4a5f-ab43-6cd1af397087 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:10:55.031991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0568-8e88-4a5f-ab43-6cd1af397087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:55.034185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0568-8e88-4a5f-ab43-6cd1af397087 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:55.042958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 586/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 21:10:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:10:57.014021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869571bb-ac04-4664-b7f6-03cb2308b116 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:57.014553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869571bb-ac04-4664-b7f6-03cb2308b116 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:57.014553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869571bb-ac04-4664-b7f6-03cb2308b116 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:57.015928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 581/1167] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:57.021847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7aea-37eb-4e7d-9ea2-fc4cb641d4b0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:57.022299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7aea-37eb-4e7d-9ea2-fc4cb641d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:57.022474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7aea-37eb-4e7d-9ea2-fc4cb641d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:57.041346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6ecf7aea-37eb-4e7d-9ea2-fc4cb641d4b0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:57.042589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6ecf7aea-37eb-4e7d-9ea2-fc4cb641d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:57.111561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 587/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:57.389593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869571bb-ac04-4664-b7f6-03cb2308b116 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:10:57.496999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869571bb-ac04-4664-b7f6-03cb2308b116 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:10:57.529888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0801c-544a-4ba4-a870-fb9dfd82c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:10:57.530484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0801c-544a-4ba4-a870-fb9dfd82c051 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:57.530759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0801c-544a-4ba4-a870-fb9dfd82c051 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:57.531033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0801c-544a-4ba4-a870-fb9dfd82c051 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:57.532189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0801c-544a-4ba4-a870-fb9dfd82c051 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:10:57.533583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0801c-544a-4ba4-a870-fb9dfd82c051 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:10:57.629758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 582/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Mon Aug 29 21:10:57 2022] POST /identity/v3/domains => generated 267 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:10:59.581212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee140d-63ef-4132-91c0-c3617a938d3d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:59.581745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee140d-63ef-4132-91c0-c3617a938d3d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:59.581745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee140d-63ef-4132-91c0-c3617a938d3d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:59.583095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 588/1170] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:10:59.588304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb87f0-5561-4111-8cdd-111f41ed4385 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:10:59.588720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb87f0-5561-4111-8cdd-111f41ed4385 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:10:59.588845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb87f0-5561-4111-8cdd-111f41ed4385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:10:59.607887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-89fb87f0-5561-4111-8cdd-111f41ed4385 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:10:59.609194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-89fb87f0-5561-4111-8cdd-111f41ed4385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:10:59.638913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:10:59.677355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 583/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:10:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:10:59.945680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee140d-63ef-4132-91c0-c3617a938d3d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:00.043615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:00.053317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee140d-63ef-4132-91c0-c3617a938d3d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:00.086790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7631e-556f-4018-82f9-ac2088314995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:00.087411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7631e-556f-4018-82f9-ac2088314995 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:00.087684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7631e-556f-4018-82f9-ac2088314995 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:00.087948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7631e-556f-4018-82f9-ac2088314995 None admin] PATH_INFO: `/v3/domains/6a3b8c16330648bfbc4e2d4b9a8d46a3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:00.099523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7631e-556f-4018-82f9-ac2088314995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a3b8c16330648bfbc4e2d4b9a8d46a3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:00.100966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7631e-556f-4018-82f9-ac2088314995 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:00.102658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 589/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Aug 29 21:10:59 2022] GET /identity/v3/domains/6a3b8c16330648bfbc4e2d4b9a8d46a3 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:00.108596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb87f0-5561-4111-8cdd-111f41ed4385 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:00.207411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb87f0-5561-4111-8cdd-111f41ed4385 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:00.241212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7d579-0f1c-4d01-a740-9bc200019f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:00.241910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7d579-0f1c-4d01-a740-9bc200019f86 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:00.242211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7d579-0f1c-4d01-a740-9bc200019f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:00.242519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7d579-0f1c-4d01-a740-9bc200019f86 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:00.243223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7d579-0f1c-4d01-a740-9bc200019f86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:00.244818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7d579-0f1c-4d01-a740-9bc200019f86 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:00.389311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 584/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:11:00 2022] POST /identity/v3/projects => generated 361 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:11:02.344156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1a096-7f94-4e67-b3d2-093f9cbb1546 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:02.344735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1a096-7f94-4e67-b3d2-093f9cbb1546 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:02.344735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1a096-7f94-4e67-b3d2-093f9cbb1546 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:02.346902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 590/1174] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:11:02.352046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0859ab-069a-447c-9d61-e6a16890835c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:02.352485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0859ab-069a-447c-9d61-e6a16890835c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:02.352609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0859ab-069a-447c-9d61-e6a16890835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:02.370986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-aa0859ab-069a-447c-9d61-e6a16890835c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:11:02.372224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-aa0859ab-069a-447c-9d61-e6a16890835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:11:02.386058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:02.441628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 585/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:11:02.720633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1a096-7f94-4e67-b3d2-093f9cbb1546 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:02.825081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1a096-7f94-4e67-b3d2-093f9cbb1546 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:02.860293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fb5c6-a54d-4966-abbb-da41b4c06c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:02.871416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fb5c6-a54d-4966-abbb-da41b4c06c97 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:02.871416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fb5c6-a54d-4966-abbb-da41b4c06c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:02.871416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fb5c6-a54d-4966-abbb-da41b4c06c97 None admin] PATH_INFO: `/v3/domains/6a3b8c16330648bfbc4e2d4b9a8d46a3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:02.871416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fb5c6-a54d-4966-abbb-da41b4c06c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a3b8c16330648bfbc4e2d4b9a8d46a3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:02.871416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fb5c6-a54d-4966-abbb-da41b4c06c97 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:02.871416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 591/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Aug 29 21:11:02 2022] GET /identity/v3/domains/6a3b8c16330648bfbc4e2d4b9a8d46a3 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:02.871951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0859ab-069a-447c-9d61-e6a16890835c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:02.975434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0859ab-069a-447c-9d61-e6a16890835c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:03.009342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292c059-cdf9-4a85-82c2-d2d1392108aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:03.009943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c059-cdf9-4a85-82c2-d2d1392108aa None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:03.010225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c059-cdf9-4a85-82c2-d2d1392108aa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:03.010518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c059-cdf9-4a85-82c2-d2d1392108aa None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:03.011196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c059-cdf9-4a85-82c2-d2d1392108aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:03.012638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c059-cdf9-4a85-82c2-d2d1392108aa None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:03.133905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 586/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:11:02 2022] POST /identity/v3/users => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:11:05.084807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d116b5-eb0a-4f6f-ace9-676847599e2d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:05.085476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d116b5-eb0a-4f6f-ace9-676847599e2d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:05.085565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d116b5-eb0a-4f6f-ace9-676847599e2d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:05.086829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 592/1178] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:11:05.092206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4b3b-d33f-4dc1-93d2-266787acad45 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:05.092686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4b3b-d33f-4dc1-93d2-266787acad45 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:05.092792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4b3b-d33f-4dc1-93d2-266787acad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:05.106883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:05.112839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-63be4b3b-d33f-4dc1-93d2-266787acad45 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:11:05.114098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-63be4b3b-d33f-4dc1-93d2-266787acad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:11:05.183380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 587/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:11:05.455889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d116b5-eb0a-4f6f-ace9-676847599e2d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:05.478433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:05.563673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d116b5-eb0a-4f6f-ace9-676847599e2d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:05.600055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:05.600661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:05.600936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:05.601233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:05.612187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:11:05.617022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:11:05.618195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:11:05.619098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 593/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:11:05.624551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4b3b-d33f-4dc1-93d2-266787acad45 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:05.732540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4b3b-d33f-4dc1-93d2-266787acad45 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:05.767042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:05.767650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:05.767926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:05.768195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:05.768926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:11:05.769253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:05.770625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:05.772843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:05.779174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 588/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:05.785973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:05.870786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:05.889395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503be1-6b14-4177-b551-69a2d26e1bc1 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:05.924924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:05.925777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:05.926027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:05.926510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] PATH_INFO: `/v3/users/9944c3e4c6504993a2d0b13faddc5f4e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:05.940574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] RBAC: Authorizing `identity:get_user(user_id=9944c3e4c6504993a2d0b13faddc5f4e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:05.942056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:05.943842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 594/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:11:05 2022] GET /identity/v3/users/9944c3e4c6504993a2d0b13faddc5f4e => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:05.950291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:06.051628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c04d1-d14c-454d-b960-dc7117cacc7f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:06.085967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:06.091982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:06.091982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:06.091982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:06.155289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:06.158819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:06.160381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:06.262375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 589/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:11:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:11:06.268494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:06.389990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8767-50d6-4cdd-bbf4-b70dd1590a14 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:06.424112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cda55-d4d6-4728-a759-ea5b5ea66850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:06.424775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cda55-d4d6-4728-a759-ea5b5ea66850 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:06.425055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cda55-d4d6-4728-a759-ea5b5ea66850 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:06.425351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cda55-d4d6-4728-a759-ea5b5ea66850 None admin] PATH_INFO: `/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:06.426476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cda55-d4d6-4728-a759-ea5b5ea66850 None admin] RBAC: Authorizing `identity:get_project(project_id=1f1d582b14dd4c0b8e79c6b68bdcae05)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:06.427900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cda55-d4d6-4728-a759-ea5b5ea66850 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:06.429722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 595/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:11:06 2022] GET /identity/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:11:06.435792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:06.532333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:06.536233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca604c-f2f7-41de-a2b1-d6caec95fa3c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:06.570843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0344c9-2717-42bb-80d7-faf0c3a7a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:06.571444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0344c9-2717-42bb-80d7-faf0c3a7a09e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:06.571720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0344c9-2717-42bb-80d7-faf0c3a7a09e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:06.571986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0344c9-2717-42bb-80d7-faf0c3a7a09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:06.572703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0344c9-2717-42bb-80d7-faf0c3a7a09e None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=1f1d582b14dd4c0b8e79c6b68bdcae05, user.id=9944c3e4c6504993a2d0b13faddc5f4e) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:11:06.573004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0344c9-2717-42bb-80d7-faf0c3a7a09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:06.574447 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0344c9-2717-42bb-80d7-faf0c3a7a09e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:06.579948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 590/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:11:06 2022] GET /identity/v3/role_assignments?user.id=9944c3e4c6504993a2d0b13faddc5f4e&scope.project.id=1f1d582b14dd4c0b8e79c6b68bdcae05&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:08.489258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04155b-d855-4e09-b2ba-490e68c91f03 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:08.489834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04155b-d855-4e09-b2ba-490e68c91f03 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:08.489834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04155b-d855-4e09-b2ba-490e68c91f03 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:08.491223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 596/1186] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:11:08.496740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cc371-4c10-45d1-b7bb-3d9a1e63faaf None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:08.497313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cc371-4c10-45d1-b7bb-3d9a1e63faaf None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:08.497313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cc371-4c10-45d1-b7bb-3d9a1e63faaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:08.516316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-954cc371-4c10-45d1-b7bb-3d9a1e63faaf None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:11:08.517550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-954cc371-4c10-45d1-b7bb-3d9a1e63faaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:11:08.588523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 591/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:11:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:11:08.859665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04155b-d855-4e09-b2ba-490e68c91f03 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:08.869161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:08.964349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04155b-d855-4e09-b2ba-490e68c91f03 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:08.998843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:08.999459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:08.999736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:09.000008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:09.010299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:11:09.015042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:11:09.016695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:11:09.017631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 597/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:11:09.023616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cc371-4c10-45d1-b7bb-3d9a1e63faaf None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:09.115617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:09.126642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cc371-4c10-45d1-b7bb-3d9a1e63faaf None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:09.167566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:09.168175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:09.168453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:09.168724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:09.169507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:11:09.169809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:09.171174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:09.179382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 592/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:09.185442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:09.251729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:09.285462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561afb7-b30a-43e0-8c9c-cfd71335c14f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:09.320639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:09.321289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:09.321565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:09.321828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] PATH_INFO: `/v3/users/9944c3e4c6504993a2d0b13faddc5f4e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:09.322961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] RBAC: Authorizing `identity:get_user(user_id=9944c3e4c6504993a2d0b13faddc5f4e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:09.324407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:09.325993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 598/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:11:09 2022] GET /identity/v3/users/9944c3e4c6504993a2d0b13faddc5f4e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:09.331939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:09.438982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c0292-136d-427a-abdc-bd8c25b95e93 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:09.475057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eedfb-1171-411c-8086-e90b7226a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:09.475676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eedfb-1171-411c-8086-e90b7226a94e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:09.475951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eedfb-1171-411c-8086-e90b7226a94e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:09.476302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eedfb-1171-411c-8086-e90b7226a94e None admin] PATH_INFO: `/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:09.477373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eedfb-1171-411c-8086-e90b7226a94e None admin] RBAC: Authorizing `identity:get_project(project_id=1f1d582b14dd4c0b8e79c6b68bdcae05)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:09.478789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eedfb-1171-411c-8086-e90b7226a94e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:09.480398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 593/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:11:09 2022] GET /identity/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:11:09.487017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:09.598599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0492f4-c354-43a9-946d-4c90d7ae0295 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:09.633520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7f6a-9fbf-46af-9cdb-95aac00ded25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:09.634176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f6a-9fbf-46af-9cdb-95aac00ded25 None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:09.634456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f6a-9fbf-46af-9cdb-95aac00ded25 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:09.634762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f6a-9fbf-46af-9cdb-95aac00ded25 None admin] PATH_INFO: `/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05/users/9944c3e4c6504993a2d0b13faddc5f4e/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:09.636671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7f6a-9fbf-46af-9cdb-95aac00ded25 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f1d582b14dd4c0b8e79c6b68bdcae05, user_id=9944c3e4c6504993a2d0b13faddc5f4e, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:09.638308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7f6a-9fbf-46af-9cdb-95aac00ded25 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:09.640482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:09.755644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 599/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:11:09 2022] PUT /identity/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05/users/9944c3e4c6504993a2d0b13faddc5f4e/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:11:11.661440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ca67d-ac13-45c0-902c-e439dcdf22fe None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:11.661990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ca67d-ac13-45c0-902c-e439dcdf22fe None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:11.661990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ca67d-ac13-45c0-902c-e439dcdf22fe None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:11.663342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 594/1193] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:11:11.668916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abab9dc-dd04-4b9a-ac9d-ff71a997723d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:11.669531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abab9dc-dd04-4b9a-ac9d-ff71a997723d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:11.669531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abab9dc-dd04-4b9a-ac9d-ff71a997723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:11.688500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0abab9dc-dd04-4b9a-ac9d-ff71a997723d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:11:11.689730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0abab9dc-dd04-4b9a-ac9d-ff71a997723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:11:11.761275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 600/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:11:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:11:12.034260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ca67d-ac13-45c0-902c-e439dcdf22fe None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:12.060768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:12.150452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ca67d-ac13-45c0-902c-e439dcdf22fe None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:12.192316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:12.192953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:12.193290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:12.193552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:12.204864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:11:12.209817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:11:12.211120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:11:12.212287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 595/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:11:12.217096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abab9dc-dd04-4b9a-ac9d-ff71a997723d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:12.330397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abab9dc-dd04-4b9a-ac9d-ff71a997723d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:12.354513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:12.365868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:12.367182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:12.367182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:12.367182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:12.367754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:11:12.368057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:12.369443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:12.377992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 601/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:12.384432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:12.475875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:12.495407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85360cc0-3551-4914-8ab6-3d8890f3a5ab None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:12.533592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:12.534226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:12.534506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:12.534862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] PATH_INFO: `/v3/users/9944c3e4c6504993a2d0b13faddc5f4e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:12.535941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] RBAC: Authorizing `identity:get_user(user_id=9944c3e4c6504993a2d0b13faddc5f4e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:12.537496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:12.539151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 596/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 21:11:12 2022] GET /identity/v3/users/9944c3e4c6504993a2d0b13faddc5f4e => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:12.545460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:12.658952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ac32-660b-4953-88e9-f35132cb5fdd None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:12.695795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:12.696455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:12.696677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:12.696949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:12.755032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:12.770234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:12.772779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:12.879212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 602/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:11:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:11:12.885377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:12.993278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1147f-90e2-4bf5-94cc-714d6c09fce8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:13.028406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd7bd4-26e4-4817-9cab-610b82536780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:13.029034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd7bd4-26e4-4817-9cab-610b82536780 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:13.029347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd7bd4-26e4-4817-9cab-610b82536780 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:13.029623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd7bd4-26e4-4817-9cab-610b82536780 None admin] PATH_INFO: `/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:13.030740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd7bd4-26e4-4817-9cab-610b82536780 None admin] RBAC: Authorizing `identity:get_project(project_id=1f1d582b14dd4c0b8e79c6b68bdcae05)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:13.032893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd7bd4-26e4-4817-9cab-610b82536780 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:13.034618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 597/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 21:11:12 2022] GET /identity/v3/projects/1f1d582b14dd4c0b8e79c6b68bdcae05 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:13.040855 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:11:13.129319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:13.145018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efde1-e6f5-4e2b-864c-4a51342a4486 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:11:13.184455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840c92b-07ec-40fc-9bf6-bd227b50e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:11:13.185236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840c92b-07ec-40fc-9bf6-bd227b50e97a None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:11:13.185646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840c92b-07ec-40fc-9bf6-bd227b50e97a None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:11:13.186014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840c92b-07ec-40fc-9bf6-bd227b50e97a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:11:13.186841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840c92b-07ec-40fc-9bf6-bd227b50e97a None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=1f1d582b14dd4c0b8e79c6b68bdcae05, user.id=9944c3e4c6504993a2d0b13faddc5f4e) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:11:13.187232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840c92b-07ec-40fc-9bf6-bd227b50e97a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:11:13.189299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840c92b-07ec-40fc-9bf6-bd227b50e97a None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:11:13.195850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 603/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:11:13 2022] GET /identity/v3/role_assignments?user.id=9944c3e4c6504993a2d0b13faddc5f4e&scope.project.id=1f1d582b14dd4c0b8e79c6b68bdcae05&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:11:23.023923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=91 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:11:23.192666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=25 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:36.467948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1704c9-f380-4121-bacc-39aea4a87cae None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:36.468604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1704c9-f380-4121-bacc-39aea4a87cae None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:36.468604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1704c9-f380-4121-bacc-39aea4a87cae None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:36.469968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 598/1201] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:12:36.475436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808ff0-383c-47eb-91c1-8141603cf097 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:36.475911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808ff0-383c-47eb-91c1-8141603cf097 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:36.476019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808ff0-383c-47eb-91c1-8141603cf097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:36.494284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-fe808ff0-383c-47eb-91c1-8141603cf097 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:12:36.497367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-fe808ff0-383c-47eb-91c1-8141603cf097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:12:36.562117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 604/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:12:36.833422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1704c9-f380-4121-bacc-39aea4a87cae None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:36.945563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1704c9-f380-4121-bacc-39aea4a87cae None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:36.981502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:36.982131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:36.982411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:36.982733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:36.992566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:36.994033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:37.009504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:37.010827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:37.011825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:37.011825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:37.011825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:37.011825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 599/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:37.017597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808ff0-383c-47eb-91c1-8141603cf097 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:37.121044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808ff0-383c-47eb-91c1-8141603cf097 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:37.158552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:37.165910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26efcc3-71c7-4abc-974e-3b793335210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:37.167838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efcc3-71c7-4abc-974e-3b793335210c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:37.167838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efcc3-71c7-4abc-974e-3b793335210c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:37.167838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efcc3-71c7-4abc-974e-3b793335210c None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:37.167838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efcc3-71c7-4abc-974e-3b793335210c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:37.168235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efcc3-71c7-4abc-974e-3b793335210c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:37.169351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efcc3-71c7-4abc-974e-3b793335210c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:37.181114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 605/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:12:37.187588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:37.247478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:37.297344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58eee4-03a6-46fe-9298-3024f9d804fe None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:37.333274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50262573-58a6-438e-991d-49d1ade2a66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:37.333892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262573-58a6-438e-991d-49d1ade2a66c None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:37.334173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262573-58a6-438e-991d-49d1ade2a66c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:37.334443 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262573-58a6-438e-991d-49d1ade2a66c None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:37.335117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50262573-58a6-438e-991d-49d1ade2a66c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:37.336538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50262573-58a6-438e-991d-49d1ade2a66c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:37.600670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 600/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 21:12:37 2022] POST /identity/v3/users => generated 251 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:12:39.563715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19371-b2db-4c3b-b480-7914ee9fb102 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:39.564280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19371-b2db-4c3b-b480-7914ee9fb102 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:39.564280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19371-b2db-4c3b-b480-7914ee9fb102 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:39.565674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 606/1206] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:12:39.570874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243d9c-ebe7-47e1-a1de-f00b9eb3ce12 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:39.571292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243d9c-ebe7-47e1-a1de-f00b9eb3ce12 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:39.571420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243d9c-ebe7-47e1-a1de-f00b9eb3ce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:39.591311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-db243d9c-ebe7-47e1-a1de-f00b9eb3ce12 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:12:39.593155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-db243d9c-ebe7-47e1-a1de-f00b9eb3ce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:12:39.660020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 601/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:12:39.925979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e19371-b2db-4c3b-b480-7914ee9fb102 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:40.028227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e19371-b2db-4c3b-b480-7914ee9fb102 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:40.065915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:40.066575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:40.066848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:40.067117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:40.078032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:12:40.083030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:40.085121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:40.086433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 607/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:12:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:12:40.090754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243d9c-ebe7-47e1-a1de-f00b9eb3ce12 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:40.130705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:40.191240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243d9c-ebe7-47e1-a1de-f00b9eb3ce12 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:40.225188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:40.225846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:40.226147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:40.226423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:40.227086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:40.227393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:40.228763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:40.237031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 602/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:12:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:40.243063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:40.296020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:40.346710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a49b33-0df2-4167-8621-22f27d17219b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:40.382821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:40.383451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:40.383745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:40.384071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:40.397373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:40.399010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:40.414549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:40.415709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:40.416600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:40.416600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:40.416600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:40.416600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 608/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:40.421984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:40.521724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:40.524623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b50f06-6344-4b9f-b023-c355ec66f159 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:40.558285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:40.558890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:40.559177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:40.559451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:40.560093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:40.560442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:40.562413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:40.573812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 603/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:40.579597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:40.683680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8552c-32e8-4e69-a3a5-a09743d46554 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:40.685224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:40.718943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:40.719595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:40.719862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:40.720162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:40.727408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:40.728839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:12:40.740812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:40.742117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:40.743540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 609/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:40.747764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:40.851806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d4020-b0d8-4bcb-95c8-21d2f4dc1bdb None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:40.885752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:40.886385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:40.886662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:40.886932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:40.887652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:40.887956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:40.889423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:40.907009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 604/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 21:12:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:40.912765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:41.015062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea955-5719-44b8-b181-722f09309ce8 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:41.048643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:41.049264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:41.049545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:41.049816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:41.080601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:41.117700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:41.119129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:41.215736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 610/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:12:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:12:41.222734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:41.243627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:41.329955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f91d-07d3-463e-8855-c0e6ce16eead None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:41.367542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:41.368176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:41.368451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:41.368725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:41.379806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:41.381312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:41.397794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:41.398979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:41.400062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:41.400062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:41.400062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:41.400062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 605/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:41.405540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:41.477511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:41.517675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f3eb-8f12-4992-b506-d409bcc9a529 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:41.550851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:41.551503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:41.551778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:41.552048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:41.552683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:41.552983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:41.554358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:41.566510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 611/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:41.572691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:41.643177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:41.673280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf771a-79dd-410d-a037-8c008430f619 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:41.707348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:41.707983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:41.708264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:41.708538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:41.715133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:41.716565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:12:41.727496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:41.728576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:41.729681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 606/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:41.734880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:41.837044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f20bb-1694-4fda-8146-ac8e80366e2e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:41.860931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:41.872323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24952b2c-9de2-4ed2-8341-c12d3f438764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:41.872961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24952b2c-9de2-4ed2-8341-c12d3f438764 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:41.873236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24952b2c-9de2-4ed2-8341-c12d3f438764 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:41.873512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24952b2c-9de2-4ed2-8341-c12d3f438764 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:41.874269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24952b2c-9de2-4ed2-8341-c12d3f438764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:41.874579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24952b2c-9de2-4ed2-8341-c12d3f438764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:41.876177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24952b2c-9de2-4ed2-8341-c12d3f438764 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:41.887725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 612/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:41.894515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:41.995827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be0022-c3fa-49c0-b875-96ec994407b6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:42.023432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:42.029084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e454c9-fbe9-4327-941d-1432de3ef200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:42.030251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e454c9-fbe9-4327-941d-1432de3ef200 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:42.030532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e454c9-fbe9-4327-941d-1432de3ef200 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:42.030805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e454c9-fbe9-4327-941d-1432de3ef200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:42.031521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e454c9-fbe9-4327-941d-1432de3ef200 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=62ffefb33aa940f3a6634ed6745e16d2) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:42.031827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e454c9-fbe9-4327-941d-1432de3ef200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:42.033292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e454c9-fbe9-4327-941d-1432de3ef200 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:42.038570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 607/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:12:41 2022] GET /identity/v3/role_assignments?user.id=62ffefb33aa940f3a6634ed6745e16d2&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:43.938676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5e42-84bc-4876-860c-5d49bb71ccef None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:43.939250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5e42-84bc-4876-860c-5d49bb71ccef None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:43.939250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5e42-84bc-4876-860c-5d49bb71ccef None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:43.940565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 613/1220] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:12:43.945975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fbe0-5f46-45d5-bb72-8e5b691628af None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:43.946431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fbe0-5f46-45d5-bb72-8e5b691628af None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:43.946781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fbe0-5f46-45d5-bb72-8e5b691628af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:43.964821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e8d4fbe0-5f46-45d5-bb72-8e5b691628af None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:12:43.966032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e8d4fbe0-5f46-45d5-bb72-8e5b691628af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:12:44.032816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 608/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:12:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:12:44.305692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5e42-84bc-4876-860c-5d49bb71ccef None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:44.411203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5e42-84bc-4876-860c-5d49bb71ccef None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:44.449755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:44.450406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:44.450785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:44.450987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:44.461260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:12:44.466108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:44.467862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:44.468707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 614/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:12:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:44.473824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fbe0-5f46-45d5-bb72-8e5b691628af None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:44.574461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fbe0-5f46-45d5-bb72-8e5b691628af None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:44.598750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:44.609814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:44.610416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:44.610692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:44.610957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:44.611611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] RBAC: Adding query filter params (name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:44.611911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:44.613343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:44.621383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 609/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:12:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:44.627394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:44.672356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:44.727376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79adaf7-611a-42d5-87db-49f09eeffbbc None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:44.761183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:44.761811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:44.762089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:44.762357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:44.772673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:44.774135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:44.788286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:44.789458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:44.790819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:44.790819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:44.790819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:44.790819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 615/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:44.796061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:44.902128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada467-42a2-45ae-b323-045c5ead1156 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:44.936533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:44.937166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:44.937445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:44.937714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:44.938398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:44.938703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:44.940066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:44.952479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 610/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:44.958414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:45.053840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:45.060433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715384e-3d26-455a-aabb-5bd0471332b9 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:45.096148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:45.096885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:45.097329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:45.097676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:45.105215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:45.106612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:12:45.118817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:45.119973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:45.120955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 616/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:45.126686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:45.175174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:45.229789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cc39-1e5d-4bf7-b681-c528f5a6f25f None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:45.263248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:45.264499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:45.264781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:45.265053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:45.265822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:45.266128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:45.267563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:45.285318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 611/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 21:12:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:45.291175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:45.392287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d553a-2560-409f-b6dd-f1ff5a8c2bf4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:45.426931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:45.427561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:45.427839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:45.428109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:45.439219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:45.440667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:45.455912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:45.457120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:45.458210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:45.458210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:45.458210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:45.458210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 617/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:45.463066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:45.562448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937274-2bf0-4735-9ad6-54747f7402de None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:45.564704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:45.596054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:45.596729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:45.597005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:45.597303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:45.597935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:45.598236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:45.599585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:45.610911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 612/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:45.616647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:45.626678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:45.721518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d9db4-b9cb-40f7-bdd3-e9be516aea10 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:45.757128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:45.757761 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:45.758043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:45.758316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:45.765574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:45.767027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:12:45.779364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:45.780449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:45.781439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 618/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:45.786475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:45.895221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5546e17-78f7-4f37-9c4c-b0c07a95e87d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:45.929110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d772-0c20-43d6-824e-075b053b34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:45.929738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d772-0c20-43d6-824e-075b053b34d2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:45.930018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d772-0c20-43d6-824e-075b053b34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:45.930289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d772-0c20-43d6-824e-075b053b34d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:45.931181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d772-0c20-43d6-824e-075b053b34d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:45.931306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d772-0c20-43d6-824e-075b053b34d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:45.932739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d772-0c20-43d6-824e-075b053b34d2 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:45.945325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 613/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:45.952180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:46.017435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:46.057743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ff5-3f3e-4678-bd7b-6b125071b94e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:46.092436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd77e0-5698-4457-bd48-235de0d48ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:46.093108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd77e0-5698-4457-bd48-235de0d48ffa None admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:46.093394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd77e0-5698-4457-bd48-235de0d48ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:46.093669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd77e0-5698-4457-bd48-235de0d48ffa None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/62ffefb33aa940f3a6634ed6745e16d2/roles/290a4533dad74846ae9cadca3f9000e5` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:46.107872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd77e0-5698-4457-bd48-235de0d48ffa None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=62ffefb33aa940f3a6634ed6745e16d2, role_id=290a4533dad74846ae9cadca3f9000e5)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:46.109363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd77e0-5698-4457-bd48-235de0d48ffa None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:46.216062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 619/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:12:45 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/62ffefb33aa940f3a6634ed6745e16d2/roles/290a4533dad74846ae9cadca3f9000e5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:12:48.120446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef54-73d3-46f1-8e53-0abe803726da None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:48.120963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef54-73d3-46f1-8e53-0abe803726da None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:48.120963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef54-73d3-46f1-8e53-0abe803726da None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:48.122538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 614/1233] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:12:48.127942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b59a63-258d-4c84-b0ef-d0b09b0ecb5d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:48.128376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b59a63-258d-4c84-b0ef-d0b09b0ecb5d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:48.128476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b59a63-258d-4c84-b0ef-d0b09b0ecb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:48.147182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-75b59a63-258d-4c84-b0ef-d0b09b0ecb5d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:12:48.148436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-75b59a63-258d-4c84-b0ef-d0b09b0ecb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:12:48.218358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 620/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:12:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:12:48.493772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aef54-73d3-46f1-8e53-0abe803726da None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:48.518828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:48.596506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aef54-73d3-46f1-8e53-0abe803726da None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:48.630498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:48.631127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:48.631451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:48.631723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:48.641598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:12:48.646323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:48.653572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:48.654628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 615/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 21:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:48.655493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b59a63-258d-4c84-b0ef-d0b09b0ecb5d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:48.700385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:48.756715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b59a63-258d-4c84-b0ef-d0b09b0ecb5d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:48.790490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:48.791117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:48.791398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:48.791673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:48.792336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] RBAC: Adding query filter params (name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:48.794102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:48.794102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:48.803010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 621/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 21:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:48.808906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:48.899425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:48.915158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95597b7-8fd5-4709-823a-1cf0a28a0ffa None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:48.950241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:48.950867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:48.951147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:48.951421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:48.962294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:48.965175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:48.978661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:48.979825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:48.980940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:48.980940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:48.980940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:48.980940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 616/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:48.986570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:49.088313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ad8e6-842c-4a51-89f2-60736f77029c None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:49.097716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:49.122803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:49.123395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:49.123677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:49.123950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:49.124691 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:49.125002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:49.126393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:49.138223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 622/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:49.144297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:49.246201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d4b8-1236-47ec-92e3-116d5ad7140d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:49.280224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:49.280846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:49.281150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:49.281420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:49.284019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:49.288813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:49.290260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:12:49.301610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:49.302539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:49.303662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 617/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:49.308585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:49.411005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bc372-a8a2-4f8b-ba48-b00ccddd1734 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:49.445304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:49.445903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:49.446178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:49.446692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:49.447414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:49.447716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:49.449153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:49.467178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 623/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 21:12:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:49.473004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:49.573255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cacfb-8ef8-49f3-94b0-4326bd933b0e None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:49.607149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:49.607746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:49.608027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:49.608300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:49.669294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:49.677120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:49.678568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:49.775787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 618/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:12:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:12:49.782175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:49.810239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:49.883855 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff000f0-fc85-423a-ae68-ab8a9129bd55 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:49.917265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:49.917890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:49.918171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:49.918443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:49.930140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:49.931503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:49.945976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:49.947422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:49.948675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:49.948675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:49.948675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:49.948675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 624/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:49.953266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:50.070787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:50.077823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2a4d-6cef-47fb-8043-232ee35de04c None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:50.115910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:50.118625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:50.118625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:50.118625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:50.118625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:50.118625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:50.119576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:50.131731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 619/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:50.137615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:50.219922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:50.241160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920918d5-0a75-4e06-ab14-fcdafeadf01b None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:50.277266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:50.277890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:50.278167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:50.278438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:50.285827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:50.287291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:12:50.298526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:50.299487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:50.301145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 625/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:50.306584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:50.408753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c47b7-1485-4eaf-9262-3a9edcb0bb75 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:50.442454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91dc86-99c0-4e74-9081-e716f327d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:50.443056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91dc86-99c0-4e74-9081-e716f327d644 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:50.443337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91dc86-99c0-4e74-9081-e716f327d644 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:50.443610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91dc86-99c0-4e74-9081-e716f327d644 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:50.444295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91dc86-99c0-4e74-9081-e716f327d644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:50.444602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91dc86-99c0-4e74-9081-e716f327d644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:50.446059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91dc86-99c0-4e74-9081-e716f327d644 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:50.459200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 620/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:50.465781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:50.567108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28426b7-ef22-427f-b1f5-1da4898ad87d None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:50.601327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c36d0-4b95-4ee6-8247-5e3f64f3c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:50.601904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c36d0-4b95-4ee6-8247-5e3f64f3c736 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:50.602185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c36d0-4b95-4ee6-8247-5e3f64f3c736 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:50.602460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c36d0-4b95-4ee6-8247-5e3f64f3c736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:50.603179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c36d0-4b95-4ee6-8247-5e3f64f3c736 None admin] RBAC: Adding query filter params (role.id=290a4533dad74846ae9cadca3f9000e5, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=62ffefb33aa940f3a6634ed6745e16d2) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:50.603490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c36d0-4b95-4ee6-8247-5e3f64f3c736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:50.604915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c36d0-4b95-4ee6-8247-5e3f64f3c736 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:50.610773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 626/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:12:50 2022] GET /identity/v3/role_assignments?user.id=62ffefb33aa940f3a6634ed6745e16d2&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=290a4533dad74846ae9cadca3f9000e5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:52.599147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42780c-938d-40b1-af42-869269a7339b None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:52.599721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42780c-938d-40b1-af42-869269a7339b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:52.599721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42780c-938d-40b1-af42-869269a7339b None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:52.601119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 621/1247] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:12:52.606125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56635c7c-fafc-46de-a03c-1ceca70c5c98 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:52.614831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56635c7c-fafc-46de-a03c-1ceca70c5c98 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:52.614831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56635c7c-fafc-46de-a03c-1ceca70c5c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:52.614831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:52.625341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-56635c7c-fafc-46de-a03c-1ceca70c5c98 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:12:52.626626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-56635c7c-fafc-46de-a03c-1ceca70c5c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:12:52.692717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 627/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:12:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:12:52.970105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42780c-938d-40b1-af42-869269a7339b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:52.989565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:53.078976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42780c-938d-40b1-af42-869269a7339b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:53.113599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:53.114178 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:53.114465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:53.114739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:53.127352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:12:53.132202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:53.133410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:53.134234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 622/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:53.139675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56635c7c-fafc-46de-a03c-1ceca70c5c98 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:53.239130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56635c7c-fafc-46de-a03c-1ceca70c5c98 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:53.268640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:53.273515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:53.274123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:53.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:53.274677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:53.275340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:53.275646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:53.277082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:53.285608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 628/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:53.291500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:53.369276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:53.392302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f202-cb4a-4a9b-b6a4-cd96ccc9ad03 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:53.426922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:53.427542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:53.427821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:53.428091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:53.437905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:53.439847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:53.454905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:53.456222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:53.457579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:53.457579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:53.457579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:53.457579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 623/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:53.462521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:53.566289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fecbe5-fcc1-4fc3-88a8-7d4eb06aed8f None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:53.600092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:53.600685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:53.600965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:53.601400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:53.602048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:53.602351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:53.603745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:53.616134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 629/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:53.622322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:53.722643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17b38-434d-4988-9fb9-c1555d6bf2cd None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:53.748540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:53.756305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:53.756927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:53.757234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:53.757508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:53.764952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:53.768508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:12:53.777361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:53.778974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:53.780002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 624/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:53.784830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:53.839826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:53.883793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3324-fa9d-4717-ba88-af085790fdfc None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:53.919113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:53.919720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:53.920055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:53.920333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:53.921246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:53.921568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:53.923098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:53.940170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 630/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 21:12:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:53.946055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:54.048697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63ab1-81a8-487d-ac24-a1025311ba1d None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:54.084196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:54.084920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:54.085234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:54.085513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:54.142109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:54.155339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:54.156804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:54.254972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 625/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:12:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:12:54.261036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:54.363651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a0566-62d2-4735-9d9e-ea43025b8053 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:54.376661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:54.396923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:54.397503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:54.397781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:54.398050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:54.408558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:54.409997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:54.425156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:54.431005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:54.432145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:54.432145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:54.432145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:54.432145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 631/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:54.432416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:54.521297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:54.533809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0e83-746f-4231-a006-e054b99d2db9 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:54.567444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:54.568088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:54.568368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:54.568641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:54.569315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:54.569625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:54.570981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:54.583146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 626/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:54.589574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:54.688839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539cc9-aadc-4c2d-9915-2b847f3383a4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:54.722710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:54.723333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:54.723608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:54.723878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:54.730350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:54.731788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:12:54.742766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:54.744448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:12:54.745882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 632/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:54.749894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:54.854644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4782b9-c7ef-48ce-84c6-438df7c47356 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:54.887593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad872bc-bcba-49d3-b1a5-b3029683b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:54.888687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad872bc-bcba-49d3-b1a5-b3029683b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:54.888955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad872bc-bcba-49d3-b1a5-b3029683b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:54.889250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad872bc-bcba-49d3-b1a5-b3029683b6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:54.889967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad872bc-bcba-49d3-b1a5-b3029683b6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:54.890282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad872bc-bcba-49d3-b1a5-b3029683b6d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:54.891702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad872bc-bcba-49d3-b1a5-b3029683b6d0 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:54.904348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 627/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:54.910770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:54.935823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:55.010124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5c0bf-2dc6-4aee-a957-3c6ef62b51b2 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:55.045438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c459c29-2290-4bb9-8228-1ec064c78d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:55.046030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c459c29-2290-4bb9-8228-1ec064c78d8f None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:55.046306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c459c29-2290-4bb9-8228-1ec064c78d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:55.046575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c459c29-2290-4bb9-8228-1ec064c78d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:55.047285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c459c29-2290-4bb9-8228-1ec064c78d8f None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=62ffefb33aa940f3a6634ed6745e16d2) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:55.047584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c459c29-2290-4bb9-8228-1ec064c78d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:55.048990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c459c29-2290-4bb9-8228-1ec064c78d8f None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:55.054190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 633/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:12:54 2022] GET /identity/v3/role_assignments?user.id=62ffefb33aa940f3a6634ed6745e16d2&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:56.959188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d325a-254e-4efc-bae3-04e0a7410e11 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:56.959705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d325a-254e-4efc-bae3-04e0a7410e11 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:56.959792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d325a-254e-4efc-bae3-04e0a7410e11 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:56.961055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 628/1261] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:12:56.966927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8880f50-2c1e-4056-bf3b-fd646d3832c0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:56.967347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8880f50-2c1e-4056-bf3b-fd646d3832c0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:56.967486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8880f50-2c1e-4056-bf3b-fd646d3832c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:56.985695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f8880f50-2c1e-4056-bf3b-fd646d3832c0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:12:56.986878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f8880f50-2c1e-4056-bf3b-fd646d3832c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:12:57.054281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 634/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:12:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:12:57.327608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d325a-254e-4efc-bae3-04e0a7410e11 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:57.338617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:57.429855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d325a-254e-4efc-bae3-04e0a7410e11 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:57.463070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:57.463693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:57.463975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:57.464251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:57.475069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:12:57.480708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:57.486159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:57.487229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 629/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:57.488558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8880f50-2c1e-4056-bf3b-fd646d3832c0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:57.507479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:57.587186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8880f50-2c1e-4056-bf3b-fd646d3832c0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:57.620078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:57.620675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:57.620952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:57.621253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:57.621953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:57.622270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:57.624138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:57.631774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 635/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:57.637511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:57.704397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:57.738503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875cf8a-a6b8-429b-9986-7f954de895a2 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:57.771608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:57.772235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:57.772508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:57.772776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:57.783216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:57.784828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:57.799115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:57.808521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:57.809649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:57.809649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:57.809649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:57.809649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 630/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:57.809945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:57.890571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:57.909039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929de2f-a769-4a82-9ede-0a375ceaf164 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:57.942647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:57.943246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:57.943555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:57.943794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:57.944430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:57.944732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:57.946117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:57.956999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 636/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:57.962883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:58.063658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3b7d-eb8c-4d3f-bf69-4e4c216c381b None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:58.084084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:58.098339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:58.098968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:58.099249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:58.099520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:58.107885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:58.109291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:12:58.120442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:58.121599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:58.123229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 631/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:58.128310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:58.229567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657737-ef0f-4eeb-8811-208d8c332ee3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:58.262615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:58.263889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:58.264106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:58.264445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:58.265175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:58.265420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:58.266835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:58.276007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:58.284531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 637/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 21:12:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:58.290394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:58.407590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02aff7-bdbc-467b-8141-13aafaaca4c9 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:58.441998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:58.442649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:58.442946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:58.443196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:58.454377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:58.455851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:12:58.470655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:58.472110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:12:58.473207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:12:58.473207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:12:58.473207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:58.473207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 632/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:58.477789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:58.584156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e33718-b5df-4c85-b03c-8617d82bf5e4 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:58.618463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:58.619064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:58.619347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:58.619595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:58.620229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:58.620599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:58.622004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:58.633029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 638/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:58.641647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:58.673462 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:58.740795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b85d-635e-4a52-ac9c-8e87bbe3d9a6 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:58.774594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:58.775284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:58.775566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:58.775840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:58.782848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:58.784265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:12:58.795982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:12:58.797099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:12:58.798000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 633/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:12:58.803158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:58.866101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:58.908198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a4362-c5e5-43b3-8c48-f3ae0992ce4e None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:58.942425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c950c-9e29-420a-bc70-abf6f5ea8ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:58.942949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c950c-9e29-420a-bc70-abf6f5ea8ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:58.943219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c950c-9e29-420a-bc70-abf6f5ea8ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:58.943490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c950c-9e29-420a-bc70-abf6f5ea8ee8 None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:58.944173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c950c-9e29-420a-bc70-abf6f5ea8ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:12:58.944476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c950c-9e29-420a-bc70-abf6f5ea8ee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:58.945926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c950c-9e29-420a-bc70-abf6f5ea8ee8 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:58.958470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 639/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:12:58.964548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:12:59.055444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:12:59.064527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4223e4-2f25-4c06-af1b-70798a6ddc06 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:12:59.099203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb950f-8515-43c1-af11-ce765a964755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:12:59.099860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb950f-8515-43c1-af11-ce765a964755 None admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:12:59.100135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb950f-8515-43c1-af11-ce765a964755 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:12:59.100405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb950f-8515-43c1-af11-ce765a964755 None admin] PATH_INFO: `/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/62ffefb33aa940f3a6634ed6745e16d2/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:12:59.102351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb950f-8515-43c1-af11-ce765a964755 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff9710b9a08545889cc2bcc26bcd8ab0, user_id=62ffefb33aa940f3a6634ed6745e16d2, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:12:59.103771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb950f-8515-43c1-af11-ce765a964755 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:12:59.204206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 634/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 21:12:58 2022] PUT /identity/v3/projects/ff9710b9a08545889cc2bcc26bcd8ab0/users/62ffefb33aa940f3a6634ed6745e16d2/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:13:01.085520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed788-60a4-4596-a64f-53d76c066d9f None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:01.086081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed788-60a4-4596-a64f-53d76c066d9f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:01.086081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed788-60a4-4596-a64f-53d76c066d9f None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:01.087403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 640/1274] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:13:01.093044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835004c-0ce2-44f7-9051-b4d3b0ea32bc None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:01.093505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835004c-0ce2-44f7-9051-b4d3b0ea32bc None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:01.093635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835004c-0ce2-44f7-9051-b4d3b0ea32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:01.112258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7835004c-0ce2-44f7-9051-b4d3b0ea32bc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:13:01.113467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7835004c-0ce2-44f7-9051-b4d3b0ea32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:13:01.185001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 635/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:13:01.462583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed788-60a4-4596-a64f-53d76c066d9f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:01.570726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed788-60a4-4596-a64f-53d76c066d9f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:01.588806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:01.605524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:01.606731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:01.607023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:01.607336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:01.617684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:13:01.623174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:01.624393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:01.625525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 641/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 21:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:01.630691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835004c-0ce2-44f7-9051-b4d3b0ea32bc None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:01.711641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:01.730001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835004c-0ce2-44f7-9051-b4d3b0ea32bc None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:01.763292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:01.763898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:01.764177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:01.764449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:01.771414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:01.771414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:01.771414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:01.774764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 636/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 21:13:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:01.781140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:01.883652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad67eb-3e8a-4186-b279-c66df67f38fa None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:01.919927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:01.920548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:01.920821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:01.921113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:01.931639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:01.933123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:13:01.948065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:01.949126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:13:01.950024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:13:01.950024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:13:01.950024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:01.950024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 642/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:01.955258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:02.057519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b7e6-d55d-42e9-8b38-00f0f6eab6a5 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:02.091774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:02.092380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:02.092661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:02.092962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:02.093628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:02.094170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:02.095278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:02.106703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 637/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:02.112553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:02.143603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:02.211560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb925937-c898-44e9-9d33-d0ca2ef5b3f3 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:02.244862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:02.265629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:02.265629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:02.265629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:02.265629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:02.265629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:13:02.267107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:02.273151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:02.274405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 643/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:13:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:02.275160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:02.278735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:02.376605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17ee27-6b58-4f5f-8a88-2a3fdbe46e12 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:02.410663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:02.411265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:02.411543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:02.411810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:02.414580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:02.414580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:02.414580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:02.431078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 638/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 21:13:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:02.436943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:02.533261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:02.542432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ece4a-8859-40fc-be72-b5684ea2a523 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:02.578205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:02.578811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:02.579091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:02.579363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:02.648321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:02.649731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:02.744618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 644/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 21:13:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:13:02.749108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:02.751343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:02.813517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:02.851971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180cc25-78fd-4935-90c0-9b2788222794 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:02.885149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:02.885777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:02.886060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:02.886334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:02.896569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:02.898039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:13:02.913154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:02.914216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:13:02.915151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:13:02.915151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:13:02.915151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:13:02.915151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 639/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:02.920503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:03.019622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04870a-88ee-4be6-82e1-f045a14bcfdf None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:03.053317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:03.053913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:03.054186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:03.054449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:03.055076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:03.055374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:03.056741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:03.067710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 645/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 21:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:03.073831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:03.180509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315f713-bc3b-4a97-8b21-b231a7ef0f13 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:03.194720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:03.216272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:03.216908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:03.217213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:03.217488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:03.224008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:03.225633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:13:03.236665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:03.238527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: ERROR keystone.server.flask.application Aug 29 21:13:03.239777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 640/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 21:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:03.243797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:03.293418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:03.343173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e28224-922c-45cf-ac85-1fff1e155126 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:03.376302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19182-f33b-4b11-83df-e1ea5d8523cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:03.376902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19182-f33b-4b11-83df-e1ea5d8523cb None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:03.377213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19182-f33b-4b11-83df-e1ea5d8523cb None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:03.377487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19182-f33b-4b11-83df-e1ea5d8523cb None admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:03.378175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d19182-f33b-4b11-83df-e1ea5d8523cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:03.378480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d19182-f33b-4b11-83df-e1ea5d8523cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:03.379903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d19182-f33b-4b11-83df-e1ea5d8523cb None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:03.392867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 646/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 21:13:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:03.399015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:03.502338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18080a6-d328-4a85-b07b-8559073656fe None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:03.536160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9d9d7-36d1-40be-bd9d-90f1a391f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:03.536798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d9d7-36d1-40be-bd9d-90f1a391f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:03.537087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d9d7-36d1-40be-bd9d-90f1a391f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:03.537370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d9d7-36d1-40be-bd9d-90f1a391f0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:03.538097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9d9d7-36d1-40be-bd9d-90f1a391f0a3 None admin] RBAC: Adding query filter params (role.id=c68d8e3fc79c47a1a950f0b4bb08a17e, scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0, user.id=62ffefb33aa940f3a6634ed6745e16d2) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:03.538395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9d9d7-36d1-40be-bd9d-90f1a391f0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:03.539822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9d9d7-36d1-40be-bd9d-90f1a391f0a3 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:03.546036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 641/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 21:13:03 2022] GET /identity/v3/role_assignments?user.id=62ffefb33aa940f3a6634ed6745e16d2&scope.project.id=ff9710b9a08545889cc2bcc26bcd8ab0&role.id=c68d8e3fc79c47a1a950f0b4bb08a17e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:05.468828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a44b1-cf50-4bc0-8276-df66f7b978cd None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:05.469471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a44b1-cf50-4bc0-8276-df66f7b978cd None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:05.469471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a44b1-cf50-4bc0-8276-df66f7b978cd None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:05.470753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 647/1288] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:13:05.475939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299a92-4add-4465-88c3-8495c8c40779 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:05.476455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299a92-4add-4465-88c3-8495c8c40779 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:05.476455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299a92-4add-4465-88c3-8495c8c40779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:05.494297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-18299a92-4add-4465-88c3-8495c8c40779 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:13:05.495489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-18299a92-4add-4465-88c3-8495c8c40779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:13:05.525362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:05.561669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 642/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:13:05.827018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a44b1-cf50-4bc0-8276-df66f7b978cd None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:05.927484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a44b1-cf50-4bc0-8276-df66f7b978cd None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:05.937964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:05.961320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:05.961942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:05.962215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:05.962483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] PATH_INFO: `/v3/services/placement` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:05.963120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:05.964466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:05.973498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:05.974741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:05.975850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 648/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:13:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:05.980775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18299a92-4add-4465-88c3-8495c8c40779 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:06.079238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18299a92-4add-4465-88c3-8495c8c40779 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:06.114258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f59ca-5a91-45d6-aa2b-630904b9df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:06.114872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f59ca-5a91-45d6-aa2b-630904b9df45 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:06.115153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f59ca-5a91-45d6-aa2b-630904b9df45 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:06.115425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f59ca-5a91-45d6-aa2b-630904b9df45 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:06.116085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f59ca-5a91-45d6-aa2b-630904b9df45 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:06.116389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f59ca-5a91-45d6-aa2b-630904b9df45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:06.117776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f59ca-5a91-45d6-aa2b-630904b9df45 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:06.123121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 643/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 21:13:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:06.129198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:06.229703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e69fbc-53b5-4f90-9861-50ecfdbc8dbe None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:06.263333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db6be-126d-4c2a-b73b-939abb288cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:06.263968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db6be-126d-4c2a-b73b-939abb288cdc None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:06.264288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db6be-126d-4c2a-b73b-939abb288cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:06.264561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db6be-126d-4c2a-b73b-939abb288cdc None admin] PATH_INFO: `/v3/services` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:06.265222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4db6be-126d-4c2a-b73b-939abb288cdc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:06.265527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4db6be-126d-4c2a-b73b-939abb288cdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:06.266879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4db6be-126d-4c2a-b73b-939abb288cdc None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:06.271257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 649/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 21:13:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:08.199975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be022-48c2-49cf-bc12-65f625c0eb01 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:08.200488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be022-48c2-49cf-bc12-65f625c0eb01 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:08.200488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be022-48c2-49cf-bc12-65f625c0eb01 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:08.201814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 644/1293] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:13:08.206926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976e9d-a599-4806-a7c9-864629d65a01 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:08.207346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976e9d-a599-4806-a7c9-864629d65a01 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:08.207488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976e9d-a599-4806-a7c9-864629d65a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:08.226192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-46976e9d-a599-4806-a7c9-864629d65a01 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:13:08.227420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-46976e9d-a599-4806-a7c9-864629d65a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:13:08.257262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:08.294088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 650/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:13:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:13:08.565486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be022-48c2-49cf-bc12-65f625c0eb01 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:08.597556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:08.668402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be022-48c2-49cf-bc12-65f625c0eb01 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:08.703043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0834e8-783d-4356-bc28-569736a2f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:08.703704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0834e8-783d-4356-bc28-569736a2f210 None admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:08.703988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0834e8-783d-4356-bc28-569736a2f210 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:08.704262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0834e8-783d-4356-bc28-569736a2f210 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:08.704922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0834e8-783d-4356-bc28-569736a2f210 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:08.706314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0834e8-783d-4356-bc28-569736a2f210 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:09.011706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 645/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 21:13:08 2022] POST /identity/v3/services => generated 246 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:13:10.948426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178372f-3acf-4a83-9acd-58ea549d28bb None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:10.948977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178372f-3acf-4a83-9acd-58ea549d28bb None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:10.948977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178372f-3acf-4a83-9acd-58ea549d28bb None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:10.950910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 651/1296] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:13:10.956165 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0cf6f-3542-4acc-9fde-078eba953de3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:10.956602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0cf6f-3542-4acc-9fde-078eba953de3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:10.956711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0cf6f-3542-4acc-9fde-078eba953de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:10.974878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-eae0cf6f-3542-4acc-9fde-078eba953de3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:13:10.976056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-eae0cf6f-3542-4acc-9fde-078eba953de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:13:11.049796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 646/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:13:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:13:11.320866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178372f-3acf-4a83-9acd-58ea549d28bb None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:11.422607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178372f-3acf-4a83-9acd-58ea549d28bb None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:11.457882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:11.458569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:11.458850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:11.459119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:11.459701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:11.461144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:11.470488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:11.471573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:11.472474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 652/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:13:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:11.477865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0cf6f-3542-4acc-9fde-078eba953de3 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:11.496597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:11.577593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0cf6f-3542-4acc-9fde-078eba953de3 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:11.611073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:11.612294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:11.612294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:11.612294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:11.612827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:11.613159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:11.614529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:11.619572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 647/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 21:13:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:11.625915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:11.657131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:11.725150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4a9d8-5ed6-4cdf-9f1e-df86aa5b8b53 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:11.758632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32d378-98ce-4348-884a-45304a9d1425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:11.759232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32d378-98ce-4348-884a-45304a9d1425 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:11.759531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32d378-98ce-4348-884a-45304a9d1425 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:11.759807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32d378-98ce-4348-884a-45304a9d1425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:11.760505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32d378-98ce-4348-884a-45304a9d1425 None admin] RBAC: Adding query filter params (interface=public, service_id=a6ee20a9c2964c4b9a6c4cdb697c4170, region_id=RegionOne) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:11.760816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32d378-98ce-4348-884a-45304a9d1425 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:11.762284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32d378-98ce-4348-884a-45304a9d1425 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:11.767485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 653/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 21:13:11 2022] GET /identity/v3/endpoints?service_id=a6ee20a9c2964c4b9a6c4cdb697c4170&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:11.773502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:11.858153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:11.878267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d6b5-aa23-4a04-bf2e-113f237217a8 None admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:11.920736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be780a-1272-4003-9ae1-7a283daaf0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:11.921377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be780a-1272-4003-9ae1-7a283daaf0ed None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:11.921706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be780a-1272-4003-9ae1-7a283daaf0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:11.922003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be780a-1272-4003-9ae1-7a283daaf0ed None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:11.922583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be780a-1272-4003-9ae1-7a283daaf0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:11.923953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be780a-1272-4003-9ae1-7a283daaf0ed None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:11.930695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 648/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 21:13:11 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:13:13.846166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a28-b487-4765-ba49-4caabbefba7e None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:13.846693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a28-b487-4765-ba49-4caabbefba7e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:13.846693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a28-b487-4765-ba49-4caabbefba7e None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:13.848110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 654/1302] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:13:13.853314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd469-0d74-43f1-b922-cf0763304dd0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:13.853715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd469-0d74-43f1-b922-cf0763304dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:13.853866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd469-0d74-43f1-b922-cf0763304dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:13.873620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-cfbdd469-0d74-43f1-b922-cf0763304dd0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:13:13.874833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-cfbdd469-0d74-43f1-b922-cf0763304dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:13:13.942298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 649/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:13:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:13:14.211137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a28-b487-4765-ba49-4caabbefba7e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:14.306651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:14.314238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a28-b487-4765-ba49-4caabbefba7e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:14.347508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:14.348198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:14.348524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:14.348844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:14.349504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:14.351049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:13:14.360203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:13:14.370803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application with Lock( Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: ERROR keystone.server.flask.application Aug 29 21:13:14.372329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 655/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 21:13:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:13:14.373142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd469-0d74-43f1-b922-cf0763304dd0 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:14.443531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:14.467170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd469-0d74-43f1-b922-cf0763304dd0 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:14.501367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478b876-2ce6-42bc-b0f1-0360022d8e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:14.501977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b876-2ce6-42bc-b0f1-0360022d8e39 None admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:14.502261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b876-2ce6-42bc-b0f1-0360022d8e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:14.502534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b876-2ce6-42bc-b0f1-0360022d8e39 None admin] PATH_INFO: `/v3/services` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:14.503171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478b876-2ce6-42bc-b0f1-0360022d8e39 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:13:14.503477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478b876-2ce6-42bc-b0f1-0360022d8e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:14.504845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478b876-2ce6-42bc-b0f1-0360022d8e39 None admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:14.510218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 650/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 21:13:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:13:14.516620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:13:14.619303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3f4f-598a-4313-abc4-779590ecabd5 None admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:13:14.651877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b6bc2-7be6-4b4d-b7c3-2cee518db537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:13:14.653018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6bc2-7be6-4b4d-b7c3-2cee518db537 None admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:13:14.653335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6bc2-7be6-4b4d-b7c3-2cee518db537 None admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:13:14.653609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6bc2-7be6-4b4d-b7c3-2cee518db537 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:13:14.654284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b6bc2-7be6-4b4d-b7c3-2cee518db537 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:13:14.655639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b6bc2-7be6-4b4d-b7c3-2cee518db537 None admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:13:14.815036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 656/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:13:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:13:24.576779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=30 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:13:24.810206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:30.068868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264fe5-35a3-434c-9793-bcebb6ec2756 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:30.076094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264fe5-35a3-434c-9793-bcebb6ec2756 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:30.076094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264fe5-35a3-434c-9793-bcebb6ec2756 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:30.076711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed36162-1dae-45e1-895d-7f94ca3e9f6d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:30.077190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed36162-1dae-45e1-895d-7f94ca3e9f6d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:30.077277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed36162-1dae-45e1-895d-7f94ca3e9f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:30.081480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 651/1307] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:30.173134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1ed36162-1dae-45e1-895d-7f94ca3e9f6d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:30.174997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1ed36162-1dae-45e1-895d-7f94ca3e9f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:30.331140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 657/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:21:30.641464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f01b-b2c6-40d8-8895-3125762d752b None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:30.642142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f01b-b2c6-40d8-8895-3125762d752b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:30.642649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f01b-b2c6-40d8-8895-3125762d752b None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:30.644305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 652/1309] 10.222.0.50 () {54 vars in 965 bytes} [Mon Aug 29 21:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:30.656512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180166d0-6ab6-4be6-97f1-d4cba94b003b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:30.657223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180166d0-6ab6-4be6-97f1-d4cba94b003b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:30.657763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180166d0-6ab6-4be6-97f1-d4cba94b003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:30.751168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-180166d0-6ab6-4be6-97f1-d4cba94b003b None None] MFA Rules not processed for user `e72f7d1f9961446c8938e3f161fb03f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:30.752823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-180166d0-6ab6-4be6-97f1-d4cba94b003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:30.780409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:30.856488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 658/1310] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Aug 29 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:30.866022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f01b-b2c6-40d8-8895-3125762d752b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:30.867828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7a12f01b-b2c6-40d8-8895-3125762d752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:31.007876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f01b-b2c6-40d8-8895-3125762d752b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:31.117786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a969e-121a-4143-8772-2411970832a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:31.119249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a969e-121a-4143-8772-2411970832a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:31.119676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a969e-121a-4143-8772-2411970832a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:31.120163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a969e-121a-4143-8772-2411970832a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:31.122013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8e1a969e-121a-4143-8772-2411970832a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:31.192649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:31.261518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a969e-121a-4143-8772-2411970832a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:31.263547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a969e-121a-4143-8772-2411970832a1 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:31.285446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 653/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:33.536831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3291-f2df-4cec-8850-89a3f17cf8f4 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:33.537291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3291-f2df-4cec-8850-89a3f17cf8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:33.537400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3291-f2df-4cec-8850-89a3f17cf8f4 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:33.538747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 659/1312] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:33.545080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546924da-9062-402e-b755-62f413975749 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:33.546758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546924da-9062-402e-b755-62f413975749 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:33.547239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546924da-9062-402e-b755-62f413975749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:33.622555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-546924da-9062-402e-b755-62f413975749 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:33.623783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-546924da-9062-402e-b755-62f413975749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:33.720624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 654/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:34.006827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3291-f2df-4cec-8850-89a3f17cf8f4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:34.008372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c73f3291-f2df-4cec-8850-89a3f17cf8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:34.117489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3291-f2df-4cec-8850-89a3f17cf8f4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:34.196429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:34.199880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1b489-7a86-47bc-8706-9045d1b74e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:34.200502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1b489-7a86-47bc-8706-9045d1b74e69 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:34.200780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1b489-7a86-47bc-8706-9045d1b74e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:34.201049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1b489-7a86-47bc-8706-9045d1b74e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:34.202717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c8a1b489-7a86-47bc-8706-9045d1b74e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:34.315604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1b489-7a86-47bc-8706-9045d1b74e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:34.317042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1b489-7a86-47bc-8706-9045d1b74e69 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:34.336806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 660/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:36.838873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28596a51-202a-4f94-a585-362d02187670 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:36.839437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28596a51-202a-4f94-a585-362d02187670 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:36.839437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28596a51-202a-4f94-a585-362d02187670 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:36.840791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 655/1315] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:36.846006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b910e-2b2f-45fd-bdea-77a2ea29149e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:36.846405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b910e-2b2f-45fd-bdea-77a2ea29149e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:36.846547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b910e-2b2f-45fd-bdea-77a2ea29149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:36.913570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-fd4b910e-2b2f-45fd-bdea-77a2ea29149e None None] MFA Rules not processed for user `f0e81dc5c0fe4082a7bb24f0f9f50011`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:36.914812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-fd4b910e-2b2f-45fd-bdea-77a2ea29149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:36.968921 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:37.014823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 661/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:37.322046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22255-847c-4731-ab00-2dd2d7de9f8b None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:37.322334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22255-847c-4731-ab00-2dd2d7de9f8b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:37.322607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22255-847c-4731-ab00-2dd2d7de9f8b None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:37.323957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 656/1317] 10.222.0.50 () {54 vars in 965 bytes} [Mon Aug 29 21:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:21:37.330376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834edbe-bd11-49bb-97b1-ad183294051f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:37.330663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834edbe-bd11-49bb-97b1-ad183294051f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:37.330937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834edbe-bd11-49bb-97b1-ad183294051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:37.407409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5834edbe-bd11-49bb-97b1-ad183294051f None None] MFA Rules not processed for user `e72f7d1f9961446c8938e3f161fb03f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:37.408623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5834edbe-bd11-49bb-97b1-ad183294051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:37.486206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 662/1318] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Aug 29 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:37.495378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa22255-847c-4731-ab00-2dd2d7de9f8b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:37.496925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1aa22255-847c-4731-ab00-2dd2d7de9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:37.506837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:37.602858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa22255-847c-4731-ab00-2dd2d7de9f8b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:37.677662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a5501-ab8f-4ab5-8db5-b47c4eec0156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:37.678266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a5501-ab8f-4ab5-8db5-b47c4eec0156 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:37.678542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a5501-ab8f-4ab5-8db5-b47c4eec0156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:37.678806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a5501-ab8f-4ab5-8db5-b47c4eec0156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:37.680406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ce3a5501-ab8f-4ab5-8db5-b47c4eec0156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:37.743369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:37.790600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a5501-ab8f-4ab5-8db5-b47c4eec0156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:37.792048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a5501-ab8f-4ab5-8db5-b47c4eec0156 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:37.813233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 657/1319] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:40.912253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8248831-3a2e-43d5-9788-af6571aeb867 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:40.912782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8248831-3a2e-43d5-9788-af6571aeb867 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:40.912782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8248831-3a2e-43d5-9788-af6571aeb867 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:40.914219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 663/1320] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:40.919800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f619e-7320-4829-8f08-0be3782cdcb0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:40.920475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f619e-7320-4829-8f08-0be3782cdcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:40.920475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f619e-7320-4829-8f08-0be3782cdcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:40.987587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-bb4f619e-7320-4829-8f08-0be3782cdcb0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:40.988787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bb4f619e-7320-4829-8f08-0be3782cdcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:41.085640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 658/1321] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:41.378919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8248831-3a2e-43d5-9788-af6571aeb867 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:41.380459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e8248831-3a2e-43d5-9788-af6571aeb867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:41.432813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:41.488997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8248831-3a2e-43d5-9788-af6571aeb867 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:41.562660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84005-f9a9-42f5-ac66-a4054c39f804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:41.563265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84005-f9a9-42f5-ac66-a4054c39f804 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:41.563549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84005-f9a9-42f5-ac66-a4054c39f804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:41.563823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84005-f9a9-42f5-ac66-a4054c39f804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:41.565441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-14f84005-f9a9-42f5-ac66-a4054c39f804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:41.667716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:41.681601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84005-f9a9-42f5-ac66-a4054c39f804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:41.684688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84005-f9a9-42f5-ac66-a4054c39f804 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:41.702614 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 664/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:44.957769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cb4b-53ed-43e9-92a0-6982882cdf95 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:44.958358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cb4b-53ed-43e9-92a0-6982882cdf95 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:44.958358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cb4b-53ed-43e9-92a0-6982882cdf95 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:44.959790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 659/1323] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:44.965745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960ffb-e180-4d23-b812-aae1ac5f0025 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:44.966607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960ffb-e180-4d23-b812-aae1ac5f0025 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:44.966607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960ffb-e180-4d23-b812-aae1ac5f0025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:45.040973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-50960ffb-e180-4d23-b812-aae1ac5f0025 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:45.042213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-50960ffb-e180-4d23-b812-aae1ac5f0025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:45.143962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 665/1324] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:45.426879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cb4b-53ed-43e9-92a0-6982882cdf95 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:45.428422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c1f0cb4b-53ed-43e9-92a0-6982882cdf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:45.451699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:45.542262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cb4b-53ed-43e9-92a0-6982882cdf95 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:45.626838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a571fc-f0e1-4f37-ac79-c81213423815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:45.627499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a571fc-f0e1-4f37-ac79-c81213423815 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:45.627803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a571fc-f0e1-4f37-ac79-c81213423815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:45.628078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a571fc-f0e1-4f37-ac79-c81213423815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:45.629833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-58a571fc-f0e1-4f37-ac79-c81213423815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:45.712446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:45.757829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a571fc-f0e1-4f37-ac79-c81213423815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:45.759285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a571fc-f0e1-4f37-ac79-c81213423815 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:45.778738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 660/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:47.791424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a70adb-1b70-4c72-aa9d-8db4caa41488 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:47.791964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a70adb-1b70-4c72-aa9d-8db4caa41488 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:47.791964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a70adb-1b70-4c72-aa9d-8db4caa41488 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:47.793817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 666/1326] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:47.799813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de17e71-920b-4710-93cf-fb0472d92ec7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:47.800363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de17e71-920b-4710-93cf-fb0472d92ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:47.800363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de17e71-920b-4710-93cf-fb0472d92ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:47.891531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1de17e71-920b-4710-93cf-fb0472d92ec7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:47.892831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1de17e71-920b-4710-93cf-fb0472d92ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:48.007872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 661/1327] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:48.300009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a70adb-1b70-4c72-aa9d-8db4caa41488 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:48.304110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-75a70adb-1b70-4c72-aa9d-8db4caa41488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:48.383503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:48.435479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a70adb-1b70-4c72-aa9d-8db4caa41488 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:48.515817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bd882-82cc-4fe2-bc73-3ea2581866d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:48.516422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bd882-82cc-4fe2-bc73-3ea2581866d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:48.516697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bd882-82cc-4fe2-bc73-3ea2581866d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:48.517025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bd882-82cc-4fe2-bc73-3ea2581866d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:48.518671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-444bd882-82cc-4fe2-bc73-3ea2581866d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:48.637620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:48.640445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bd882-82cc-4fe2-bc73-3ea2581866d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:48.641984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bd882-82cc-4fe2-bc73-3ea2581866d7 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:48.661467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 667/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:50.655946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173dd5-ce42-4c42-bfb9-436dfed17e2b None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:50.656506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173dd5-ce42-4c42-bfb9-436dfed17e2b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:50.656506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173dd5-ce42-4c42-bfb9-436dfed17e2b None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:50.657925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 662/1329] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:50.663412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f90e-abec-4fea-a1c4-e7ab83dac90e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:50.663987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f90e-abec-4fea-a1c4-e7ab83dac90e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:50.663987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f90e-abec-4fea-a1c4-e7ab83dac90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:50.736130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9221f90e-abec-4fea-a1c4-e7ab83dac90e None None] MFA Rules not processed for user `f0e81dc5c0fe4082a7bb24f0f9f50011`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:50.737439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9221f90e-abec-4fea-a1c4-e7ab83dac90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:50.846157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 668/1330] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:51.136409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173dd5-ce42-4c42-bfb9-436dfed17e2b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:51.138627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0e173dd5-ce42-4c42-bfb9-436dfed17e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:51.180467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:51.261094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173dd5-ce42-4c42-bfb9-436dfed17e2b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:51.335482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628377af-d71c-4146-bd14-94bd2133f84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:51.336001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628377af-d71c-4146-bd14-94bd2133f84c service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:51.336277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628377af-d71c-4146-bd14-94bd2133f84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:51.336544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628377af-d71c-4146-bd14-94bd2133f84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:51.338182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-628377af-d71c-4146-bd14-94bd2133f84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:51.422226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:51.454806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628377af-d71c-4146-bd14-94bd2133f84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:51.457561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628377af-d71c-4146-bd14-94bd2133f84c service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:51.476946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 663/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:53.881273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231871a3-6f8c-423d-a3d7-03a1c4e7c7a9 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:53.881861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231871a3-6f8c-423d-a3d7-03a1c4e7c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:53.881861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231871a3-6f8c-423d-a3d7-03a1c4e7c7a9 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:53.883276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 669/1332] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:53.889346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43101d1d-30b2-4330-979a-b0866c8a22a3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:53.889874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43101d1d-30b2-4330-979a-b0866c8a22a3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:53.889874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43101d1d-30b2-4330-979a-b0866c8a22a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:53.959539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-43101d1d-30b2-4330-979a-b0866c8a22a3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:53.960755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-43101d1d-30b2-4330-979a-b0866c8a22a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:54.065479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 664/1333] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:54.347840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231871a3-6f8c-423d-a3d7-03a1c4e7c7a9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:54.349454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-231871a3-6f8c-423d-a3d7-03a1c4e7c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:54.425420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:54.461443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231871a3-6f8c-423d-a3d7-03a1c4e7c7a9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:54.536031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3606f8-145e-457e-80cc-630f2f9afec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:54.536642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3606f8-145e-457e-80cc-630f2f9afec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:54.536917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3606f8-145e-457e-80cc-630f2f9afec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:54.537216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3606f8-145e-457e-80cc-630f2f9afec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:54.538821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9f3606f8-145e-457e-80cc-630f2f9afec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:54.662665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3606f8-145e-457e-80cc-630f2f9afec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:54.664160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3606f8-145e-457e-80cc-630f2f9afec1 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:54.674677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:54.682979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 670/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:21:56.687845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8370-543f-4b2e-98f6-93308908bcfe None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:56.688414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8370-543f-4b2e-98f6-93308908bcfe None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:56.688414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8370-543f-4b2e-98f6-93308908bcfe None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:56.689772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 665/1335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:21:56.694934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c188-9eb1-4cdf-a83b-dab3e3f8b9db None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:56.695351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c188-9eb1-4cdf-a83b-dab3e3f8b9db None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:56.695489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c188-9eb1-4cdf-a83b-dab3e3f8b9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:56.764694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2766c188-9eb1-4cdf-a83b-dab3e3f8b9db None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:21:56.766205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2766c188-9eb1-4cdf-a83b-dab3e3f8b9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:56.865887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 671/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:21:57.157029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c8370-543f-4b2e-98f6-93308908bcfe None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:21:57.158604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-527c8370-543f-4b2e-98f6-93308908bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:57.200872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:57.272435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c8370-543f-4b2e-98f6-93308908bcfe None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:21:57.347811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f247b27-9b32-4e61-8cfc-4a9eaed7054a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:21:57.348427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247b27-9b32-4e61-8cfc-4a9eaed7054a service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:21:57.348707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247b27-9b32-4e61-8cfc-4a9eaed7054a service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:21:57.348977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247b27-9b32-4e61-8cfc-4a9eaed7054a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:21:57.350639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2f247b27-9b32-4e61-8cfc-4a9eaed7054a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:21:57.438217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:57.464005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f247b27-9b32-4e61-8cfc-4a9eaed7054a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:21:57.465499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f247b27-9b32-4e61-8cfc-4a9eaed7054a service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:21:57.483376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 666/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:00.034712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d173-2f05-4ca5-b397-a3a2f28313d4 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:00.035270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d173-2f05-4ca5-b397-a3a2f28313d4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:00.035270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d173-2f05-4ca5-b397-a3a2f28313d4 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:00.036598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 672/1338] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:00.043422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cebd-dfc4-4ffb-8d75-e8851fdec8a3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:00.043872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cebd-dfc4-4ffb-8d75-e8851fdec8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:00.043967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cebd-dfc4-4ffb-8d75-e8851fdec8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:00.111958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a117cebd-dfc4-4ffb-8d75-e8851fdec8a3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:00.113128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a117cebd-dfc4-4ffb-8d75-e8851fdec8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:00.224667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 667/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:00.515065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d173-2f05-4ca5-b397-a3a2f28313d4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:00.516633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-85e9d173-2f05-4ca5-b397-a3a2f28313d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:00.594608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:00.622938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d173-2f05-4ca5-b397-a3a2f28313d4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:00.696411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c72788-9e56-4c29-a6ca-8adcbe74d856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:00.697087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c72788-9e56-4c29-a6ca-8adcbe74d856 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:00.697324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c72788-9e56-4c29-a6ca-8adcbe74d856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:00.697595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c72788-9e56-4c29-a6ca-8adcbe74d856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:00.700896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-32c72788-9e56-4c29-a6ca-8adcbe74d856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:00.807469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c72788-9e56-4c29-a6ca-8adcbe74d856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:00.809551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c72788-9e56-4c29-a6ca-8adcbe74d856 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:00.828150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 673/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:05.297358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ffcd-1a82-4edd-8da8-f5cd4cd8ac2c None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:05.298136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ffcd-1a82-4edd-8da8-f5cd4cd8ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:05.298136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ffcd-1a82-4edd-8da8-f5cd4cd8ac2c None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:05.299278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 668/1341] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:05.305575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7648-7e68-400e-9260-d5c7ff96d19b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:05.306306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7648-7e68-400e-9260-d5c7ff96d19b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:05.306306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7648-7e68-400e-9260-d5c7ff96d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:05.313108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:05.399608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e07a7648-7e68-400e-9260-d5c7ff96d19b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:05.400816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e07a7648-7e68-400e-9260-d5c7ff96d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:05.525407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 674/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:05.821813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ffcd-1a82-4edd-8da8-f5cd4cd8ac2c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:05.824152 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9b77ffcd-1a82-4edd-8da8-f5cd4cd8ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:05.880975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:05.949524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ffcd-1a82-4edd-8da8-f5cd4cd8ac2c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:06.035458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a6b03-a2ad-44ef-87c8-ba75c864bd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:06.036180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a6b03-a2ad-44ef-87c8-ba75c864bd40 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:06.036519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a6b03-a2ad-44ef-87c8-ba75c864bd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:06.036854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a6b03-a2ad-44ef-87c8-ba75c864bd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:06.038701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b60a6b03-a2ad-44ef-87c8-ba75c864bd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:06.144270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:06.162464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a6b03-a2ad-44ef-87c8-ba75c864bd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:06.167664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a6b03-a2ad-44ef-87c8-ba75c864bd40 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:06.184106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 669/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:09.316720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d30b17-ca4a-4278-9db7-3cfc7fa17bd1 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:09.317264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d30b17-ca4a-4278-9db7-3cfc7fa17bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:09.317264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d30b17-ca4a-4278-9db7-3cfc7fa17bd1 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:09.318637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 675/1344] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:09.323999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2a75-d234-4563-9ab5-6f9c4df62d50 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:09.324496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2a75-d234-4563-9ab5-6f9c4df62d50 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:09.324589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2a75-d234-4563-9ab5-6f9c4df62d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:09.396301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-459c2a75-d234-4563-9ab5-6f9c4df62d50 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:09.397552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-459c2a75-d234-4563-9ab5-6f9c4df62d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:09.498041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 670/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:09.800855 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d30b17-ca4a-4278-9db7-3cfc7fa17bd1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:09.802424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-24d30b17-ca4a-4278-9db7-3cfc7fa17bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:09.908907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:09.928221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d30b17-ca4a-4278-9db7-3cfc7fa17bd1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:10.007558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecc85c-d368-4a5f-9dc9-d40219eeb3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:10.008163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc85c-d368-4a5f-9dc9-d40219eeb3ca service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:10.008435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc85c-d368-4a5f-9dc9-d40219eeb3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:10.008704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc85c-d368-4a5f-9dc9-d40219eeb3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:10.010442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0eecc85c-d368-4a5f-9dc9-d40219eeb3ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:10.133604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecc85c-d368-4a5f-9dc9-d40219eeb3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:10.134955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecc85c-d368-4a5f-9dc9-d40219eeb3ca service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:10.155493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 676/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:14.395487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea69d-ab8e-40a7-bafa-7e5caf34599e None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:14.396016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea69d-ab8e-40a7-bafa-7e5caf34599e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:14.396016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea69d-ab8e-40a7-bafa-7e5caf34599e None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:14.397311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 671/1347] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:14.403451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905495-9100-4ce3-984a-b671bde9cc6f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:14.403999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905495-9100-4ce3-984a-b671bde9cc6f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:14.403999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905495-9100-4ce3-984a-b671bde9cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:14.420960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:14.478729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7e905495-9100-4ce3-984a-b671bde9cc6f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:14.480506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7e905495-9100-4ce3-984a-b671bde9cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:14.588017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 677/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:14.876766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aea69d-ab8e-40a7-bafa-7e5caf34599e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:14.878427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-25aea69d-ab8e-40a7-bafa-7e5caf34599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:14.940194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:14.989672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aea69d-ab8e-40a7-bafa-7e5caf34599e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:15.064813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fc938-7d10-44e8-a29a-4dbc90080576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:15.065443 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fc938-7d10-44e8-a29a-4dbc90080576 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:15.065723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fc938-7d10-44e8-a29a-4dbc90080576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:15.065993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fc938-7d10-44e8-a29a-4dbc90080576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:15.067607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8c1fc938-7d10-44e8-a29a-4dbc90080576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:15.184393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:15.188347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fc938-7d10-44e8-a29a-4dbc90080576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:15.189834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fc938-7d10-44e8-a29a-4dbc90080576 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:15.208775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 672/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:20.382541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad378a-0736-453e-8c51-711cb4c71c04 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:20.382541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad378a-0736-453e-8c51-711cb4c71c04 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:20.383043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad378a-0736-453e-8c51-711cb4c71c04 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:20.386240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 678/1350] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:20.398354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1f30-f919-4d2b-8369-22b67c31fabb None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:20.398772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1f30-f919-4d2b-8369-22b67c31fabb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:20.398872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1f30-f919-4d2b-8369-22b67c31fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:20.531020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1cea1f30-f919-4d2b-8369-22b67c31fabb None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:20.532263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1cea1f30-f919-4d2b-8369-22b67c31fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:20.655753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 673/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:24.588887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=59 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:24.956473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ffca-71f6-43e3-a37a-6b3a13a61a56 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:24.957150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ffca-71f6-43e3-a37a-6b3a13a61a56 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:24.957545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ffca-71f6-43e3-a37a-6b3a13a61a56 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:24.959400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 679/1352] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:24.964645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1bf2-3a51-4022-8f44-8ebeb9d14f8e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:24.965139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1bf2-3a51-4022-8f44-8ebeb9d14f8e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:24.965510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1bf2-3a51-4022-8f44-8ebeb9d14f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:25.035827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:25.068876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-22fa1bf2-3a51-4022-8f44-8ebeb9d14f8e None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:25.070383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-22fa1bf2-3a51-4022-8f44-8ebeb9d14f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:25.193875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 674/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:26.631384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555bad9-2f1a-496a-ba4c-d21dbfed3b61 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:26.631916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555bad9-2f1a-496a-ba4c-d21dbfed3b61 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:26.631916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555bad9-2f1a-496a-ba4c-d21dbfed3b61 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:26.633709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 680/1354] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:26.639105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b73a-5d41-4213-bb7e-7a901ac14e54 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:26.639608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b73a-5d41-4213-bb7e-7a901ac14e54 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:26.639608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b73a-5d41-4213-bb7e-7a901ac14e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:26.721636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f112b73a-5d41-4213-bb7e-7a901ac14e54 None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:26.722922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f112b73a-5d41-4213-bb7e-7a901ac14e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:26.767908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:26.839787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 675/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:30.195546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0efd-2bac-48e3-84cf-788040520176 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:30.196088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0efd-2bac-48e3-84cf-788040520176 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:30.196088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0efd-2bac-48e3-84cf-788040520176 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:30.197523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 681/1356] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:30.202986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20ea1a-8f54-4699-ac2c-f330df22ccb5 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:30.203441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20ea1a-8f54-4699-ac2c-f330df22ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:30.203546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20ea1a-8f54-4699-ac2c-f330df22ccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:30.292961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-0a20ea1a-8f54-4699-ac2c-f330df22ccb5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:30.294238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0a20ea1a-8f54-4699-ac2c-f330df22ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:30.457516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 676/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:30.759619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd7d50-9f9d-4990-9012-cce1a156667c None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:30.760502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd7d50-9f9d-4990-9012-cce1a156667c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:30.761005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd7d50-9f9d-4990-9012-cce1a156667c None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:30.763239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 682/1358] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 21:22:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:30.775952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91875a-1c96-4c32-b380-18f1c0e55f8d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:30.776704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91875a-1c96-4c32-b380-18f1c0e55f8d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:30.782236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91875a-1c96-4c32-b380-18f1c0e55f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:30.805390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:30.880385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ad91875a-1c96-4c32-b380-18f1c0e55f8d None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:30.881864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ad91875a-1c96-4c32-b380-18f1c0e55f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:31.005874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 677/1359] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:22:31.013981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd7d50-9f9d-4990-9012-cce1a156667c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:31.015605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a4fd7d50-9f9d-4990-9012-cce1a156667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:31.186780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd7d50-9f9d-4990-9012-cce1a156667c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:31.270306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:31.314952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b9794-ba45-46a8-a455-c7f012b7f8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:31.315622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b9794-ba45-46a8-a455-c7f012b7f8a8 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:31.315916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b9794-ba45-46a8-a455-c7f012b7f8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:31.316185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b9794-ba45-46a8-a455-c7f012b7f8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:31.317945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-722b9794-ba45-46a8-a455-c7f012b7f8a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:31.415819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b9794-ba45-46a8-a455-c7f012b7f8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:31.417688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b9794-ba45-46a8-a455-c7f012b7f8a8 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:31.438197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 683/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:33.669481 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9158a6-4868-4123-8afb-95cd11679158 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:33.670095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9158a6-4868-4123-8afb-95cd11679158 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:33.670095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9158a6-4868-4123-8afb-95cd11679158 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:33.671545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 678/1361] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:22:33.676913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f881-4cb6-410e-bb5d-39857fb6f57c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:33.677416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f881-4cb6-410e-bb5d-39857fb6f57c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:33.677535 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f881-4cb6-410e-bb5d-39857fb6f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:33.753403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f542f881-4cb6-410e-bb5d-39857fb6f57c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:33.754788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f542f881-4cb6-410e-bb5d-39857fb6f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:33.800951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:33.892263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 684/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:34.191918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9158a6-4868-4123-8afb-95cd11679158 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:34.193561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8e9158a6-4868-4123-8afb-95cd11679158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:34.266310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:34.363168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9158a6-4868-4123-8afb-95cd11679158 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:34.500073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5070d-83d4-4696-98c8-83709a1fdc5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:34.501236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5070d-83d4-4696-98c8-83709a1fdc5a service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:34.501523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5070d-83d4-4696-98c8-83709a1fdc5a service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:34.501799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5070d-83d4-4696-98c8-83709a1fdc5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:34.503431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-45b5070d-83d4-4696-98c8-83709a1fdc5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:34.531527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:34.615372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5070d-83d4-4696-98c8-83709a1fdc5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:34.617121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5070d-83d4-4696-98c8-83709a1fdc5a service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:34.638489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 679/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:37.106422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcecc-8b96-49f7-be42-18de229e2b01 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:37.107043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcecc-8b96-49f7-be42-18de229e2b01 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:37.107043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcecc-8b96-49f7-be42-18de229e2b01 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:37.109470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 685/1364] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:37.114029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833479-714f-4d4a-8a9d-cb04f410fce3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:37.114506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833479-714f-4d4a-8a9d-cb04f410fce3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:37.114585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833479-714f-4d4a-8a9d-cb04f410fce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:37.190381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3a833479-714f-4d4a-8a9d-cb04f410fce3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:37.191451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3a833479-714f-4d4a-8a9d-cb04f410fce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:37.296149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:37.305524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 680/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:37.595618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a7cb6-7ae9-4413-a448-3b913990a694 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:37.596032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a7cb6-7ae9-4413-a448-3b913990a694 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:37.596410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a7cb6-7ae9-4413-a448-3b913990a694 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:37.598044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 686/1366] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 21:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:37.604319 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168676-0d4e-4b9d-a8dd-fc0b570fc849 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:37.604719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168676-0d4e-4b9d-a8dd-fc0b570fc849 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:37.605183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168676-0d4e-4b9d-a8dd-fc0b570fc849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:37.706176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a8168676-0d4e-4b9d-a8dd-fc0b570fc849 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:37.707552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a8168676-0d4e-4b9d-a8dd-fc0b570fc849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:37.862924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 681/1367] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:37.874056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a7cb6-7ae9-4413-a448-3b913990a694 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:37.875853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4d0a7cb6-7ae9-4413-a448-3b913990a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:38.065243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a7cb6-7ae9-4413-a448-3b913990a694 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:38.091122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:38.209675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af914623-6316-4764-92a2-9145070ee213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:38.210339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914623-6316-4764-92a2-9145070ee213 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:38.210720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914623-6316-4764-92a2-9145070ee213 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:38.211110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914623-6316-4764-92a2-9145070ee213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:38.213440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-af914623-6316-4764-92a2-9145070ee213 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:38.329028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af914623-6316-4764-92a2-9145070ee213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:38.330836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af914623-6316-4764-92a2-9145070ee213 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:38.356836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 687/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:22:38.758188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65da43-e886-4dc7-9ad6-2939702a82b8 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:38.758732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65da43-e886-4dc7-9ad6-2939702a82b8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:38.758732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65da43-e886-4dc7-9ad6-2939702a82b8 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:38.760956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 682/1369] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:22:38.766737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ddb6-d8f5-4d8c-be7d-7446c82ab9dc None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:38.766934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ddb6-d8f5-4d8c-be7d-7446c82ab9dc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:38.767202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ddb6-d8f5-4d8c-be7d-7446c82ab9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:38.804468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:38.864130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ddd2ddb6-d8f5-4d8c-be7d-7446c82ab9dc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:38.865842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ddd2ddb6-d8f5-4d8c-be7d-7446c82ab9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:38.982642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 688/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:22:39.570671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b056c-567a-4754-8a12-b375096b4b1f None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:39.570671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b056c-567a-4754-8a12-b375096b4b1f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:39.570671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b056c-567a-4754-8a12-b375096b4b1f None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:39.573646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 683/1371] 10.222.0.50 () {54 vars in 964 bytes} [Mon Aug 29 21:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:39.576808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b3d0-ada8-4c27-94e0-6c4ecba5543f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:39.577360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b3d0-ada8-4c27-94e0-6c4ecba5543f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:39.577532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b3d0-ada8-4c27-94e0-6c4ecba5543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:39.671025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-dad2b3d0-ada8-4c27-94e0-6c4ecba5543f None None] MFA Rules not processed for user `01d2e6366b3c488c8b893584f59a98db`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:39.672422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-dad2b3d0-ada8-4c27-94e0-6c4ecba5543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:39.729385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:39.769349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 689/1372] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Aug 29 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:39.777774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b056c-567a-4754-8a12-b375096b4b1f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:39.780008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f74b056c-567a-4754-8a12-b375096b4b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:39.859358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:39.925466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b056c-567a-4754-8a12-b375096b4b1f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:40.009833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3049792-3307-4691-b5e6-c44c3e88841c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:40.011875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049792-3307-4691-b5e6-c44c3e88841c service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:40.012367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049792-3307-4691-b5e6-c44c3e88841c service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:40.012687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049792-3307-4691-b5e6-c44c3e88841c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:40.015031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b3049792-3307-4691-b5e6-c44c3e88841c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:40.146411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:40.163307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3049792-3307-4691-b5e6-c44c3e88841c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:40.164669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3049792-3307-4691-b5e6-c44c3e88841c service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:40.197356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 684/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:40.619171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9889e9-a08e-489e-a8f1-849b4040e4a9 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:40.619688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9889e9-a08e-489e-a8f1-849b4040e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:40.619688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9889e9-a08e-489e-a8f1-849b4040e4a9 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:40.620970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 690/1374] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:40.626403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4205a-1674-4bd6-a9d0-c6d0419fcd0b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:40.626691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4205a-1674-4bd6-a9d0-c6d0419fcd0b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:40.626963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4205a-1674-4bd6-a9d0-c6d0419fcd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:40.696648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-75e4205a-1674-4bd6-a9d0-c6d0419fcd0b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:40.697906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-75e4205a-1674-4bd6-a9d0-c6d0419fcd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:40.802331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 685/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:41.094775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9889e9-a08e-489e-a8f1-849b4040e4a9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:41.096299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6c9889e9-a08e-489e-a8f1-849b4040e4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:41.259839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9889e9-a08e-489e-a8f1-849b4040e4a9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:41.312408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:41.378113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8751d-5526-4592-b977-db85f3e15340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:41.378785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8751d-5526-4592-b977-db85f3e15340 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:41.379069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8751d-5526-4592-b977-db85f3e15340 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:41.379339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8751d-5526-4592-b977-db85f3e15340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:41.380953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-57f8751d-5526-4592-b977-db85f3e15340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:41.475732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8751d-5526-4592-b977-db85f3e15340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:41.477357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8751d-5526-4592-b977-db85f3e15340 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:41.499030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 691/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:43.646149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fd82c-166e-4ee8-b09b-e468737d94e9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:43.646694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fd82c-166e-4ee8-b09b-e468737d94e9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:43.646694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fd82c-166e-4ee8-b09b-e468737d94e9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:43.648025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 686/1377] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:43.653371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fc9ff-e634-4c8d-849b-bedef828a1e9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:43.653834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fc9ff-e634-4c8d-849b-bedef828a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:43.653940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fc9ff-e634-4c8d-849b-bedef828a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:43.727045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-055fc9ff-e634-4c8d-849b-bedef828a1e9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:43.728878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-055fc9ff-e634-4c8d-849b-bedef828a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:43.736423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:43.840498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 692/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:44.160579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fd82c-166e-4ee8-b09b-e468737d94e9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:44.162373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c20fd82c-166e-4ee8-b09b-e468737d94e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:44.235555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:44.331262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fd82c-166e-4ee8-b09b-e468737d94e9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:44.462603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f1abe-74f2-44f1-8738-90a3ce499daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:44.463365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1abe-74f2-44f1-8738-90a3ce499daa service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:44.463652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1abe-74f2-44f1-8738-90a3ce499daa service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:44.463922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1abe-74f2-44f1-8738-90a3ce499daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:44.465826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0d9f1abe-74f2-44f1-8738-90a3ce499daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:44.488187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:44.569931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f1abe-74f2-44f1-8738-90a3ce499daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:44.571685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f1abe-74f2-44f1-8738-90a3ce499daa service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:44.592266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 687/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:46.724251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3413921-612c-48a1-a799-748316911d22 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:46.724807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3413921-612c-48a1-a799-748316911d22 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:46.724807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3413921-612c-48a1-a799-748316911d22 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:46.726224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 693/1380] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:46.732501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31571-33eb-405d-a8a0-848862da37fc None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:46.733023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31571-33eb-405d-a8a0-848862da37fc None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:46.733023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31571-33eb-405d-a8a0-848862da37fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:46.809488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f8a31571-33eb-405d-a8a0-848862da37fc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:46.810720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f8a31571-33eb-405d-a8a0-848862da37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:46.934167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:46.947339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 688/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:47.240763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3413921-612c-48a1-a799-748316911d22 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:47.242364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e3413921-612c-48a1-a799-748316911d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:47.400805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:47.411613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3413921-612c-48a1-a799-748316911d22 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:47.531329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a50ea-0ae5-4a7b-b209-6aa6463c2b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:47.531933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a50ea-0ae5-4a7b-b209-6aa6463c2b40 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:47.532213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a50ea-0ae5-4a7b-b209-6aa6463c2b40 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:47.532481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a50ea-0ae5-4a7b-b209-6aa6463c2b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:47.534078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-be8a50ea-0ae5-4a7b-b209-6aa6463c2b40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:47.636746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a50ea-0ae5-4a7b-b209-6aa6463c2b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:47.638395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a50ea-0ae5-4a7b-b209-6aa6463c2b40 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:47.649718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:47.659254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 694/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:49.926073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ae7d-ceb4-4441-aea2-acf4a5297824 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:49.926793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ae7d-ceb4-4441-aea2-acf4a5297824 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:49.927510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ae7d-ceb4-4441-aea2-acf4a5297824 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:49.931811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 689/1383] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:49.942582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4152-79ff-455b-9b13-ef5bc4bc41f0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:49.943087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4152-79ff-455b-9b13-ef5bc4bc41f0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:49.943255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4152-79ff-455b-9b13-ef5bc4bc41f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:50.018959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-950d4152-79ff-455b-9b13-ef5bc4bc41f0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:50.020188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-950d4152-79ff-455b-9b13-ef5bc4bc41f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:50.148083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 695/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:50.482693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87ae7d-ceb4-4441-aea2-acf4a5297824 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:50.484179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ba87ae7d-ceb4-4441-aea2-acf4a5297824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:50.645931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87ae7d-ceb4-4441-aea2-acf4a5297824 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:50.722235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:50.770898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2553b-11ff-46fb-8859-733cc160354a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:50.771544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2553b-11ff-46fb-8859-733cc160354a service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:50.771869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2553b-11ff-46fb-8859-733cc160354a service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:50.772162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2553b-11ff-46fb-8859-733cc160354a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:50.774551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0cb2553b-11ff-46fb-8859-733cc160354a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:50.886599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2553b-11ff-46fb-8859-733cc160354a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:50.888869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2553b-11ff-46fb-8859-733cc160354a service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:50.913906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 690/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:22:52.886422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adfb6a-2ad4-4a2a-b1dd-c7f383049ef6 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:52.886969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adfb6a-2ad4-4a2a-b1dd-c7f383049ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:52.886969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adfb6a-2ad4-4a2a-b1dd-c7f383049ef6 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:52.888346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 696/1386] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:52.894231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e019c52-372e-44d3-b354-cb734400d546 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:52.894741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e019c52-372e-44d3-b354-cb734400d546 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:52.894837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e019c52-372e-44d3-b354-cb734400d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:52.972083 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7e019c52-372e-44d3-b354-cb734400d546 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:52.973354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7e019c52-372e-44d3-b354-cb734400d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:53.010190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:53.082498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 691/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:22:53.448540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adfb6a-2ad4-4a2a-b1dd-c7f383049ef6 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:53.450194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e2adfb6a-2ad4-4a2a-b1dd-c7f383049ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:53.543443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:53.622810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adfb6a-2ad4-4a2a-b1dd-c7f383049ef6 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:53.746343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ec803-ecd5-46d4-96ac-c3b4a5403b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:53.747099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec803-ecd5-46d4-96ac-c3b4a5403b65 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:53.747520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec803-ecd5-46d4-96ac-c3b4a5403b65 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:53.747928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec803-ecd5-46d4-96ac-c3b4a5403b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:53.750041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-073ec803-ecd5-46d4-96ac-c3b4a5403b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:53.791626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:53.850488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ec803-ecd5-46d4-96ac-c3b4a5403b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:53.852943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ec803-ecd5-46d4-96ac-c3b4a5403b65 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:53.880721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 697/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:22:56.077199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d8e53-3dfd-401e-b4c2-277fde4160c8 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:56.077997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d8e53-3dfd-401e-b4c2-277fde4160c8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:56.077997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d8e53-3dfd-401e-b4c2-277fde4160c8 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:56.079365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 692/1389] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:22:56.086113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e864b1-cf75-48b8-9d03-5cc87b232daa None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:56.086685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e864b1-cf75-48b8-9d03-5cc87b232daa None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:56.086989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e864b1-cf75-48b8-9d03-5cc87b232daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:56.185226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e7e864b1-cf75-48b8-9d03-5cc87b232daa None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:56.186502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e7e864b1-cf75-48b8-9d03-5cc87b232daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:56.304343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 698/1390] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:56.606290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d8e53-3dfd-401e-b4c2-277fde4160c8 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:56.608132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-047d8e53-3dfd-401e-b4c2-277fde4160c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:56.766625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d8e53-3dfd-401e-b4c2-277fde4160c8 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:56.786068 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:56.906917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0e02d-a7e5-491d-8579-37cff3880ba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:56.907691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e02d-a7e5-491d-8579-37cff3880ba5 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:56.907973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e02d-a7e5-491d-8579-37cff3880ba5 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:56.908271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e02d-a7e5-491d-8579-37cff3880ba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:56.909972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-11e0e02d-a7e5-491d-8579-37cff3880ba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:57.015940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e02d-a7e5-491d-8579-37cff3880ba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:57.017572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e02d-a7e5-491d-8579-37cff3880ba5 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:57.038431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 693/1391] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:57.626797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147ca44-0a91-47e1-ab3b-86fea1b077d7 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:57.627331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147ca44-0a91-47e1-ab3b-86fea1b077d7 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:57.627449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147ca44-0a91-47e1-ab3b-86fea1b077d7 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:57.628748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 699/1392] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:22:57.635100 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf0bb-5fc0-46ca-bcee-80a790835b36 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:57.635567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf0bb-5fc0-46ca-bcee-80a790835b36 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:57.635791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf0bb-5fc0-46ca-bcee-80a790835b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:57.664085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:57.722759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-17caf0bb-5fc0-46ca-bcee-80a790835b36 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:57.723999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-17caf0bb-5fc0-46ca-bcee-80a790835b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:57.830065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 694/1393] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:22:58.130935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3222394-4d15-4f49-ba00-8365f0192d2c None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:58.131327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3222394-4d15-4f49-ba00-8365f0192d2c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:58.131482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3222394-4d15-4f49-ba00-8365f0192d2c None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:58.132863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 700/1394] 10.222.0.50 () {54 vars in 967 bytes} [Mon Aug 29 21:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:58.139079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331481e-e101-48de-8ab4-04f153e34920 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:58.139367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331481e-e101-48de-8ab4-04f153e34920 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:58.139642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331481e-e101-48de-8ab4-04f153e34920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:58.222420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1331481e-e101-48de-8ab4-04f153e34920 None None] MFA Rules not processed for user `b56b3fafca1e47f88482bf25a77a0fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:58.223937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1331481e-e101-48de-8ab4-04f153e34920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:58.268825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:58.307932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 695/1395] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Aug 29 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:58.315321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3222394-4d15-4f49-ba00-8365f0192d2c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:58.316841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a3222394-4d15-4f49-ba00-8365f0192d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:58.331125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:58.435903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3222394-4d15-4f49-ba00-8365f0192d2c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:58.513913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddd80e-b078-4885-9fca-c74db50e9ec6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:58.514518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddd80e-b078-4885-9fca-c74db50e9ec6 service glance] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:58.514794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddd80e-b078-4885-9fca-c74db50e9ec6 service glance] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:58.515059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddd80e-b078-4885-9fca-c74db50e9ec6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:58.516645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3cddd80e-b078-4885-9fca-c74db50e9ec6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:58.591004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:58.634454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddd80e-b078-4885-9fca-c74db50e9ec6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:22:58.635921 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddd80e-b078-4885-9fca-c74db50e9ec6 service glance] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:22:58.654460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 701/1396] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:22:59.227539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadb538-98b3-4808-9984-d1eb25343f09 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:59.228076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadb538-98b3-4808-9984-d1eb25343f09 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:59.228076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadb538-98b3-4808-9984-d1eb25343f09 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:59.229607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 696/1397] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:22:59.234906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:59.235267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:59.235634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:59.307701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:59.308929 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:59.430954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 702/1398] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:59.579243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc129fa-f62c-438c-8008-50e02d2a596d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:59.579529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc129fa-f62c-438c-8008-50e02d2a596d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:59.579805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc129fa-f62c-438c-8008-50e02d2a596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:59.651880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-9fc129fa-f62c-438c-8008-50e02d2a596d None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:59.653202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9fc129fa-f62c-438c-8008-50e02d2a596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:59.726095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:22:59.729995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:59.751108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 697/1399] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:22:59.758318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:59.796248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b505-4e06-4fcf-bf0e-0b1c3be0e6db None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:59.796630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b505-4e06-4fcf-bf0e-0b1c3be0e6db None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:59.796917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b505-4e06-4fcf-bf0e-0b1c3be0e6db None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:59.798349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 698/1400] 10.222.0.50 () {54 vars in 943 bytes} [Mon Aug 29 21:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:22:59.804941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeed3f-d30b-471e-83c0-441a87d19b18 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:59.805247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeed3f-d30b-471e-83c0-441a87d19b18 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:59.805603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeed3f-d30b-471e-83c0-441a87d19b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:59.856166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50866a1f-e5c5-43c9-85e8-bc5565e257da None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:22:59.882579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:22:59.891230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-38aeed3f-d30b-471e-83c0-441a87d19b18 None None] MFA Rules not processed for user `afacbc4812494825a43083cbba245e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:22:59.892489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-38aeed3f-d30b-471e-83c0-441a87d19b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:22:59.978208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96a0f7-2b1b-458b-9386-ced6d313eb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:22:59.978731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a0f7-2b1b-458b-9386-ced6d313eb99 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:22:59.979018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a0f7-2b1b-458b-9386-ced6d313eb99 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:22:59.979288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a0f7-2b1b-458b-9386-ced6d313eb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:22:59.980928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6d96a0f7-2b1b-458b-9386-ced6d313eb99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:00.000619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:00.006681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 699/1401] 10.222.0.50 () {58 vars in 1040 bytes} [Mon Aug 29 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:23:00.017091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeed3f-d30b-471e-83c0-441a87d19b18 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:00.026799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeed3f-d30b-471e-83c0-441a87d19b18 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:00.079917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96a0f7-2b1b-458b-9386-ced6d313eb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:00.085277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96a0f7-2b1b-458b-9386-ced6d313eb99 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:00.101162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 703/1402] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:23:00.141903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a10361-6315-4f7c-89b8-006afb6e1219 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:00.142524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a10361-6315-4f7c-89b8-006afb6e1219 service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:00.142870 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a10361-6315-4f7c-89b8-006afb6e1219 service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:00.143148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a10361-6315-4f7c-89b8-006afb6e1219 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:00.144857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-21a10361-6315-4f7c-89b8-006afb6e1219 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:00.147657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:00.235741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a10361-6315-4f7c-89b8-006afb6e1219 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:00.237380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a10361-6315-4f7c-89b8-006afb6e1219 service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:00.246705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 700/1403] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:23:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:23:02.327347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd65fea-5a09-43df-b12e-5ef0ff47b86a None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:02.327948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd65fea-5a09-43df-b12e-5ef0ff47b86a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:02.327948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd65fea-5a09-43df-b12e-5ef0ff47b86a None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:02.333449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 704/1404] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:23:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:02.335201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c55a2-01e8-4efd-8b80-e6ea5cfe66df None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:02.335686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c55a2-01e8-4efd-8b80-e6ea5cfe66df None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:02.335957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c55a2-01e8-4efd-8b80-e6ea5cfe66df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:02.420793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-803c55a2-01e8-4efd-8b80-e6ea5cfe66df None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:02.422197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-803c55a2-01e8-4efd-8b80-e6ea5cfe66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:02.541350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:02.557123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 701/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:23:02.857631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd65fea-5a09-43df-b12e-5ef0ff47b86a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:02.859203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7dd65fea-5a09-43df-b12e-5ef0ff47b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:03.060904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:03.063809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd65fea-5a09-43df-b12e-5ef0ff47b86a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:03.224384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e332937-e329-405d-a798-9b98be6f73a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:03.229177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332937-e329-405d-a798-9b98be6f73a5 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:03.229177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332937-e329-405d-a798-9b98be6f73a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:03.229177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332937-e329-405d-a798-9b98be6f73a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:03.229177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5e332937-e329-405d-a798-9b98be6f73a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:03.342256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e332937-e329-405d-a798-9b98be6f73a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:03.343892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e332937-e329-405d-a798-9b98be6f73a5 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:03.364554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 705/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:05.625295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02523a5b-b5dc-412b-9fca-4200f7d85eb8 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:05.626606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02523a5b-b5dc-412b-9fca-4200f7d85eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:05.627090 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02523a5b-b5dc-412b-9fca-4200f7d85eb8 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:05.628695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 702/1407] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:23:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:05.635261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc3c3d-3a83-4b01-85c2-210c3b8895ad None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:05.636182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc3c3d-3a83-4b01-85c2-210c3b8895ad None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:05.636644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc3c3d-3a83-4b01-85c2-210c3b8895ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:05.641267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:05.716011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a3cc3c3d-3a83-4b01-85c2-210c3b8895ad None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:05.717775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a3cc3c3d-3a83-4b01-85c2-210c3b8895ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:05.837054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 706/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:06.143512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02523a5b-b5dc-412b-9fca-4200f7d85eb8 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:06.145296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-02523a5b-b5dc-412b-9fca-4200f7d85eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:06.346512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02523a5b-b5dc-412b-9fca-4200f7d85eb8 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:06.468565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:06.526833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e3760-beec-4a72-97fb-c3dc8a4f35ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:06.527631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3760-beec-4a72-97fb-c3dc8a4f35ce service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:06.527911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3760-beec-4a72-97fb-c3dc8a4f35ce service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:06.528237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3760-beec-4a72-97fb-c3dc8a4f35ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:06.530098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f68e3760-beec-4a72-97fb-c3dc8a4f35ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:06.668337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e3760-beec-4a72-97fb-c3dc8a4f35ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:06.670057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e3760-beec-4a72-97fb-c3dc8a4f35ce service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:06.691005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 703/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:15.834906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=64 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:16.688030 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=64 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:24.302123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc55ee-758e-4f3a-abf7-54577875261e None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:24.302737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc55ee-758e-4f3a-abf7-54577875261e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:24.302737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc55ee-758e-4f3a-abf7-54577875261e None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:24.304669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 707/1410] 10.222.0.50 () {54 vars in 918 bytes} [Mon Aug 29 21:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:24.309825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53175b3f-218c-4809-8508-60719494f899 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:24.310260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53175b3f-218c-4809-8508-60719494f899 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:24.310369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53175b3f-218c-4809-8508-60719494f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:24.392382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-53175b3f-218c-4809-8508-60719494f899 None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:24.393618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-53175b3f-218c-4809-8508-60719494f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:24.502341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 704/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Aug 29 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:24.517439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9c62b-18b3-4d75-9686-1f5124395445 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:24.517719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9c62b-18b3-4d75-9686-1f5124395445 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:24.517994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9c62b-18b3-4d75-9686-1f5124395445 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:24.519310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 708/1412] 10.222.0.50 () {54 vars in 918 bytes} [Mon Aug 29 21:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:24.523984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea717c-8a6c-4c06-9910-b54e14a6b343 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:24.524271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea717c-8a6c-4c06-9910-b54e14a6b343 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:24.524545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea717c-8a6c-4c06-9910-b54e14a6b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:24.598539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:24.601292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-11ea717c-8a6c-4c06-9910-b54e14a6b343 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:24.602539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-11ea717c-8a6c-4c06-9910-b54e14a6b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:24.720409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 705/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Aug 29 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:27.128224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9a4c-0272-4334-9227-fa099d2cb5ed None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:27.129093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9a4c-0272-4334-9227-fa099d2cb5ed None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:27.129375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9a4c-0272-4334-9227-fa099d2cb5ed None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:27.130779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:27.137308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474eaef-fd06-4d15-adf4-2323d1bc546a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:27.137823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474eaef-fd06-4d15-adf4-2323d1bc546a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:27.137937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474eaef-fd06-4d15-adf4-2323d1bc546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:27.204263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d474eaef-fd06-4d15-adf4-2323d1bc546a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:27.205514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d474eaef-fd06-4d15-adf4-2323d1bc546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:27.261160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:27.303340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:27.593770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9a4c-0272-4334-9227-fa099d2cb5ed None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:27.595355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-27ab9a4c-0272-4334-9227-fa099d2cb5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:27.743778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9a4c-0272-4334-9227-fa099d2cb5ed None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:27.817582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:27.859451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a4440-932d-4d04-8e04-4998260b8217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:27.860064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a4440-932d-4d04-8e04-4998260b8217 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:27.860370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a4440-932d-4d04-8e04-4998260b8217 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:27.860639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a4440-932d-4d04-8e04-4998260b8217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:27.862336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-979a4440-932d-4d04-8e04-4998260b8217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:27.956503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a4440-932d-4d04-8e04-4998260b8217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:27.958228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a4440-932d-4d04-8e04-4998260b8217 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:27.976696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 710/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:28.874758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224309cb-6bd7-484f-a234-438856dfa61a None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:28.875286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224309cb-6bd7-484f-a234-438856dfa61a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:28.875382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224309cb-6bd7-484f-a234-438856dfa61a None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:28.876833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:23:28.882299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82a45-d605-4342-9f1a-29b135498b44 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:28.882726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82a45-d605-4342-9f1a-29b135498b44 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:28.882840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82a45-d605-4342-9f1a-29b135498b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:28.964736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-66f82a45-d605-4342-9f1a-29b135498b44 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:28.966096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-66f82a45-d605-4342-9f1a-29b135498b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:28.995085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:29.067526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:29.219644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224309cb-6bd7-484f-a234-438856dfa61a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:29.221124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-224309cb-6bd7-484f-a234-438856dfa61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:29.369471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224309cb-6bd7-484f-a234-438856dfa61a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:29.409082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:29.482698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fcc6a-5076-4be2-9de0-a9952780bc2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:29.483304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fcc6a-5076-4be2-9de0-a9952780bc2c service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:29.483579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fcc6a-5076-4be2-9de0-a9952780bc2c service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:29.483843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fcc6a-5076-4be2-9de0-a9952780bc2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:29.485490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4b8fcc6a-5076-4be2-9de0-a9952780bc2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:29.572976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fcc6a-5076-4be2-9de0-a9952780bc2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:29.574612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fcc6a-5076-4be2-9de0-a9952780bc2c service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:29.592404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 708/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:30.479233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabbbd-8341-47ef-b7ad-2b5dd19f7573 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:30.479715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabbbd-8341-47ef-b7ad-2b5dd19f7573 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:30.479812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabbbd-8341-47ef-b7ad-2b5dd19f7573 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:30.481178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:30.486237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726244c2-6a27-4c0c-aaa9-ea14a86483da None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:30.486647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726244c2-6a27-4c0c-aaa9-ea14a86483da None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:30.486786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726244c2-6a27-4c0c-aaa9-ea14a86483da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:30.541982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:30.563936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-726244c2-6a27-4c0c-aaa9-ea14a86483da None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:30.565200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-726244c2-6a27-4c0c-aaa9-ea14a86483da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:30.662664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:30.815606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aabbbd-8341-47ef-b7ad-2b5dd19f7573 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:30.817246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-88aabbbd-8341-47ef-b7ad-2b5dd19f7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:30.968388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aabbbd-8341-47ef-b7ad-2b5dd19f7573 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:30.981200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:31.083210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7328a-1900-4430-94a2-61dc0c4f19da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:31.083726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7328a-1900-4430-94a2-61dc0c4f19da service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:31.084004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7328a-1900-4430-94a2-61dc0c4f19da service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:31.084274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7328a-1900-4430-94a2-61dc0c4f19da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:31.086468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6cf7328a-1900-4430-94a2-61dc0c4f19da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:31.177309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7328a-1900-4430-94a2-61dc0c4f19da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:31.179483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7328a-1900-4430-94a2-61dc0c4f19da service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:31.197713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 713/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:32.062264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367609e-6614-42af-b9f5-c0fa60b16834 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:32.062860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367609e-6614-42af-b9f5-c0fa60b16834 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:32.062860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367609e-6614-42af-b9f5-c0fa60b16834 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:32.064129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:32.069170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38895a-63db-41d6-83fa-fe2af0aef27c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:32.070244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38895a-63db-41d6-83fa-fe2af0aef27c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:32.070354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38895a-63db-41d6-83fa-fe2af0aef27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:32.091304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:32.155321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-da38895a-63db-41d6-83fa-fe2af0aef27c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:32.156450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-da38895a-63db-41d6-83fa-fe2af0aef27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:32.255293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:32.409539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367609e-6614-42af-b9f5-c0fa60b16834 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:32.411004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e367609e-6614-42af-b9f5-c0fa60b16834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:32.523391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:32.560864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367609e-6614-42af-b9f5-c0fa60b16834 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:32.672377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc477106-5e30-4644-b447-b8149a1a15cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:32.673011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc477106-5e30-4644-b447-b8149a1a15cc service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:32.673320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc477106-5e30-4644-b447-b8149a1a15cc service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:32.673589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc477106-5e30-4644-b447-b8149a1a15cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:32.675177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bc477106-5e30-4644-b447-b8149a1a15cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:32.750482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:32.764181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc477106-5e30-4644-b447-b8149a1a15cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:32.765840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc477106-5e30-4644-b447-b8149a1a15cc service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:32.784747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 711/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:33.676490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb8988-9bfb-4db7-bad7-f9597d3f5ab0 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:33.677099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb8988-9bfb-4db7-bad7-f9597d3f5ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:33.677099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb8988-9bfb-4db7-bad7-f9597d3f5ab0 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:33.679961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:33.684212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba784f-675e-4078-9dfa-67e383738901 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:33.684671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba784f-675e-4078-9dfa-67e383738901 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:33.684774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba784f-675e-4078-9dfa-67e383738901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:33.761250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-00ba784f-675e-4078-9dfa-67e383738901 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:33.762468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-00ba784f-675e-4078-9dfa-67e383738901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:33.863202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:34.014735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb8988-9bfb-4db7-bad7-f9597d3f5ab0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:34.016248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-72cb8988-9bfb-4db7-bad7-f9597d3f5ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:34.101250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:34.164642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb8988-9bfb-4db7-bad7-f9597d3f5ab0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:34.277687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dc80-3334-463a-bf05-90371f3c2a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:34.278290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dc80-3334-463a-bf05-90371f3c2a34 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:34.278566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dc80-3334-463a-bf05-90371f3c2a34 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:34.278834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dc80-3334-463a-bf05-90371f3c2a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:34.280463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ffc5dc80-3334-463a-bf05-90371f3c2a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:34.327959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:34.371249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dc80-3334-463a-bf05-90371f3c2a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:34.372845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dc80-3334-463a-bf05-90371f3c2a34 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:34.390660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 716/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:35.242775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c815-f62b-44af-a219-0468254fcdca None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:35.243348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c815-f62b-44af-a219-0468254fcdca None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:35.243348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c815-f62b-44af-a219-0468254fcdca None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:35.244699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:23:35.250756 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bfa5-a0d4-4cdd-a1ca-62890db34a15 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:35.251228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bfa5-a0d4-4cdd-a1ca-62890db34a15 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:35.251435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bfa5-a0d4-4cdd-a1ca-62890db34a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:35.333476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b5a7bfa5-a0d4-4cdd-a1ca-62890db34a15 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:35.335298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b5a7bfa5-a0d4-4cdd-a1ca-62890db34a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:35.431463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:23:35.581618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c815-f62b-44af-a219-0468254fcdca None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:35.583041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9e63c815-f62b-44af-a219-0468254fcdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:35.632398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:35.731087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c815-f62b-44af-a219-0468254fcdca None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:35.843554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74694449-283d-46bf-b5fb-28fd83da1f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:35.844093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694449-283d-46bf-b5fb-28fd83da1f3f service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:35.844376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694449-283d-46bf-b5fb-28fd83da1f3f service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:35.844647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694449-283d-46bf-b5fb-28fd83da1f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:35.846303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-74694449-283d-46bf-b5fb-28fd83da1f3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:35.854284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:35.937398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74694449-283d-46bf-b5fb-28fd83da1f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:35.938997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74694449-283d-46bf-b5fb-28fd83da1f3f service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:35.957687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 714/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:36.817379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d1d8-2b71-4c1d-a1ae-8ccfccce6277 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:36.817961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d1d8-2b71-4c1d-a1ae-8ccfccce6277 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:36.817961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d1d8-2b71-4c1d-a1ae-8ccfccce6277 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:36.819910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:36.826136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba3e8-0bf9-459f-8241-2c00f2acba41 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:36.826710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba3e8-0bf9-459f-8241-2c00f2acba41 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:36.826710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba3e8-0bf9-459f-8241-2c00f2acba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:36.905929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f42ba3e8-0bf9-459f-8241-2c00f2acba41 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:36.907140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f42ba3e8-0bf9-459f-8241-2c00f2acba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:36.976183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:37.006376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:37.158925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063d1d8-2b71-4c1d-a1ae-8ccfccce6277 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:37.160364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9063d1d8-2b71-4c1d-a1ae-8ccfccce6277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:37.177729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:37.306788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063d1d8-2b71-4c1d-a1ae-8ccfccce6277 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:37.394052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:37.420903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48674c79-195a-4d30-877d-6f9e6ae1d5cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:37.421463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48674c79-195a-4d30-877d-6f9e6ae1d5cf service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:37.421745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48674c79-195a-4d30-877d-6f9e6ae1d5cf service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:37.422222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48674c79-195a-4d30-877d-6f9e6ae1d5cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:37.424295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-48674c79-195a-4d30-877d-6f9e6ae1d5cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:37.513507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48674c79-195a-4d30-877d-6f9e6ae1d5cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:37.515076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48674c79-195a-4d30-877d-6f9e6ae1d5cf service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:37.532659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 719/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:38.426143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3bbe7-c201-4884-9562-906312660152 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:38.426804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3bbe7-c201-4884-9562-906312660152 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:38.426804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3bbe7-c201-4884-9562-906312660152 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:38.428680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:38.433915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdf697-bbe9-4b2c-abdf-c23305c3e927 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:38.434362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdf697-bbe9-4b2c-abdf-c23305c3e927 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:38.434553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdf697-bbe9-4b2c-abdf-c23305c3e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:38.511913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-06bdf697-bbe9-4b2c-abdf-c23305c3e927 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:38.513199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-06bdf697-bbe9-4b2c-abdf-c23305c3e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:38.554489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:38.610401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:38.761971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3bbe7-c201-4884-9562-906312660152 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:38.763498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f9e3bbe7-c201-4884-9562-906312660152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:38.917739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3bbe7-c201-4884-9562-906312660152 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:38.972356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:39.030769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c173d-446c-4674-87f1-2b0af51ebc35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:39.031302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c173d-446c-4674-87f1-2b0af51ebc35 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:39.031583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c173d-446c-4674-87f1-2b0af51ebc35 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:39.031857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c173d-446c-4674-87f1-2b0af51ebc35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:39.033495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4b7c173d-446c-4674-87f1-2b0af51ebc35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:39.126177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c173d-446c-4674-87f1-2b0af51ebc35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:39.127819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c173d-446c-4674-87f1-2b0af51ebc35 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:39.146815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 717/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:40.090104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78a77-54f5-4a46-9bf7-e85545041f9d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:40.090684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78a77-54f5-4a46-9bf7-e85545041f9d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:40.090684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78a77-54f5-4a46-9bf7-e85545041f9d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:40.092000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:40.096823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94aa2f-79f1-4c75-835a-fd17954c6a83 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:40.097262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94aa2f-79f1-4c75-835a-fd17954c6a83 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:40.097410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94aa2f-79f1-4c75-835a-fd17954c6a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:40.175071 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-6a94aa2f-79f1-4c75-835a-fd17954c6a83 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:40.176299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6a94aa2f-79f1-4c75-835a-fd17954c6a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:40.178885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:40.276137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:40.430238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78a77-54f5-4a46-9bf7-e85545041f9d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:40.431668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e8b78a77-54f5-4a46-9bf7-e85545041f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:40.577653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78a77-54f5-4a46-9bf7-e85545041f9d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:40.604784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:40.691790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fe8ca-2dd7-489e-bcc1-a865a96b9347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:40.692303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe8ca-2dd7-489e-bcc1-a865a96b9347 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:40.692581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe8ca-2dd7-489e-bcc1-a865a96b9347 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:40.692850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe8ca-2dd7-489e-bcc1-a865a96b9347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:40.694978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-868fe8ca-2dd7-489e-bcc1-a865a96b9347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:40.784383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fe8ca-2dd7-489e-bcc1-a865a96b9347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:40.786014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fe8ca-2dd7-489e-bcc1-a865a96b9347 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:40.805995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 722/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:42.632376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c3b3-876f-48b9-82c6-79557c9999d5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:42.633016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c3b3-876f-48b9-82c6-79557c9999d5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:42.633016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c3b3-876f-48b9-82c6-79557c9999d5 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:42.634229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:42.639621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951adf9-58f0-48f0-bdac-9c8409822aea None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:42.640082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951adf9-58f0-48f0-bdac-9c8409822aea None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:42.640189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951adf9-58f0-48f0-bdac-9c8409822aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:42.681358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:42.706685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-3951adf9-58f0-48f0-bdac-9c8409822aea None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:42.708018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3951adf9-58f0-48f0-bdac-9c8409822aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:42.923245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:43.229931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c3b3-876f-48b9-82c6-79557c9999d5 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:43.231483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ed71c3b3-876f-48b9-82c6-79557c9999d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:43.342053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c3b3-876f-48b9-82c6-79557c9999d5 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:43.389490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:43.445995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0e24d-c8a2-4f29-8aa5-485eb2a823f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:43.446610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e24d-c8a2-4f29-8aa5-485eb2a823f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:43.446886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e24d-c8a2-4f29-8aa5-485eb2a823f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:43.447156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e24d-c8a2-4f29-8aa5-485eb2a823f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:43.448799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7af0e24d-c8a2-4f29-8aa5-485eb2a823f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:43.560666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0e24d-c8a2-4f29-8aa5-485eb2a823f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:43.562201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0e24d-c8a2-4f29-8aa5-485eb2a823f2 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:43.582552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 720/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:45.685704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f455c-cefc-44ff-8c99-1cf75b5ab6b5 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:45.686281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f455c-cefc-44ff-8c99-1cf75b5ab6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:45.686281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f455c-cefc-44ff-8c99-1cf75b5ab6b5 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:45.687592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:45.692884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1e35a-559d-4136-b76e-a5420a3f709a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:45.693537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1e35a-559d-4136-b76e-a5420a3f709a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:45.693537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1e35a-559d-4136-b76e-a5420a3f709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:45.759690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a8d1e35a-559d-4136-b76e-a5420a3f709a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:45.760889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a8d1e35a-559d-4136-b76e-a5420a3f709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:45.773575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:45.860259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:46.149497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f455c-cefc-44ff-8c99-1cf75b5ab6b5 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:46.151055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0d9f455c-cefc-44ff-8c99-1cf75b5ab6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:46.260055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f455c-cefc-44ff-8c99-1cf75b5ab6b5 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:46.274713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:46.341558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6530a-847a-4424-8ec7-bb1864e66dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:46.342184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6530a-847a-4424-8ec7-bb1864e66dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:46.342463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6530a-847a-4424-8ec7-bb1864e66dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:46.342736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6530a-847a-4424-8ec7-bb1864e66dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:46.344393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-bde6530a-847a-4424-8ec7-bb1864e66dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:46.492291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6530a-847a-4424-8ec7-bb1864e66dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:46.493766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6530a-847a-4424-8ec7-bb1864e66dc2 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:46.516963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 725/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:48.930762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9097b-6c25-4bbc-9b2d-85a3cd2cbb4f None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:48.931329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9097b-6c25-4bbc-9b2d-85a3cd2cbb4f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:48.931329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9097b-6c25-4bbc-9b2d-85a3cd2cbb4f None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:48.932691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:48.938185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfef0-3fc8-479d-b279-0a64d8c0c0df None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:48.938725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfef0-3fc8-479d-b279-0a64d8c0c0df None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:48.938725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfef0-3fc8-479d-b279-0a64d8c0c0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:48.987949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:49.006896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-729cfef0-3fc8-479d-b279-0a64d8c0c0df None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:49.008093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-729cfef0-3fc8-479d-b279-0a64d8c0c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:49.106836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:23:49.396035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9097b-6c25-4bbc-9b2d-85a3cd2cbb4f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:49.397671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-44b9097b-6c25-4bbc-9b2d-85a3cd2cbb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:49.504114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9097b-6c25-4bbc-9b2d-85a3cd2cbb4f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:49.546058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:49.580524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4de7-1220-4887-9fde-961f1514bc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:49.581453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4de7-1220-4887-9fde-961f1514bc6b service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:49.581734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4de7-1220-4887-9fde-961f1514bc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:49.582007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4de7-1220-4887-9fde-961f1514bc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:49.583670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0d5e4de7-1220-4887-9fde-961f1514bc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:49.695606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4de7-1220-4887-9fde-961f1514bc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:49.696967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4de7-1220-4887-9fde-961f1514bc6b service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:49.715915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 723/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:51.810912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a04b8-bac3-435a-ae9c-9b2245401c87 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:51.811496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a04b8-bac3-435a-ae9c-9b2245401c87 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:51.811496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a04b8-bac3-435a-ae9c-9b2245401c87 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:51.812869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:51.820892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e9a5-af82-4123-b8ef-8bc56cedb6a5 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:51.821644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e9a5-af82-4123-b8ef-8bc56cedb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:51.821644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e9a5-af82-4123-b8ef-8bc56cedb6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:51.903704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7be9e9a5-af82-4123-b8ef-8bc56cedb6a5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:51.904876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7be9e9a5-af82-4123-b8ef-8bc56cedb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:51.932783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:52.013201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:52.298973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a04b8-bac3-435a-ae9c-9b2245401c87 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:52.300537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9c2a04b8-bac3-435a-ae9c-9b2245401c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:52.410983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a04b8-bac3-435a-ae9c-9b2245401c87 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:52.431440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:52.484778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593728b-592b-42ce-8417-73de50b0312f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:52.485417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593728b-592b-42ce-8417-73de50b0312f service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:52.485701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593728b-592b-42ce-8417-73de50b0312f service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:52.485976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593728b-592b-42ce-8417-73de50b0312f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:52.487610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1593728b-592b-42ce-8417-73de50b0312f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:52.600194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593728b-592b-42ce-8417-73de50b0312f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:52.601572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593728b-592b-42ce-8417-73de50b0312f service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:52.619204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 728/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:54.665585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d984ea-12d5-43db-9a49-4d5a73016985 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:54.666162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d984ea-12d5-43db-9a49-4d5a73016985 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:54.666162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d984ea-12d5-43db-9a49-4d5a73016985 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:54.667456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:54.672767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83272d5-bf7b-4951-b074-6491feb8c03b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:54.673220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83272d5-bf7b-4951-b074-6491feb8c03b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:54.673348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83272d5-bf7b-4951-b074-6491feb8c03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:54.736705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:54.739360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a83272d5-bf7b-4951-b074-6491feb8c03b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:54.740642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a83272d5-bf7b-4951-b074-6491feb8c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:54.839327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:55.124665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d984ea-12d5-43db-9a49-4d5a73016985 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:55.126274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-20d984ea-12d5-43db-9a49-4d5a73016985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:55.231194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d984ea-12d5-43db-9a49-4d5a73016985 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:55.280056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:55.305046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92017e8-e11a-4f0d-a4a8-b6b00e9bacc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:55.305682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92017e8-e11a-4f0d-a4a8-b6b00e9bacc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:55.305958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92017e8-e11a-4f0d-a4a8-b6b00e9bacc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:55.306223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92017e8-e11a-4f0d-a4a8-b6b00e9bacc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:55.307814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d92017e8-e11a-4f0d-a4a8-b6b00e9bacc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:55.419340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92017e8-e11a-4f0d-a4a8-b6b00e9bacc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:55.420697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92017e8-e11a-4f0d-a4a8-b6b00e9bacc1 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:55.439337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 726/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:23:57.446254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b932d2-c89d-499c-b78c-bca8ac35ba31 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:57.446872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b932d2-c89d-499c-b78c-bca8ac35ba31 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:57.446872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b932d2-c89d-499c-b78c-bca8ac35ba31 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:57.448156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:23:57.453985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dec4f8-97a2-4a71-a9e8-36fa974684bc None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:57.454403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dec4f8-97a2-4a71-a9e8-36fa974684bc None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:57.454610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dec4f8-97a2-4a71-a9e8-36fa974684bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:57.521310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-04dec4f8-97a2-4a71-a9e8-36fa974684bc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:23:57.522586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-04dec4f8-97a2-4a71-a9e8-36fa974684bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:57.552774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:57.622856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:23:57.904121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b932d2-c89d-499c-b78c-bca8ac35ba31 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:23:57.905682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-13b932d2-c89d-499c-b78c-bca8ac35ba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:58.010846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b932d2-c89d-499c-b78c-bca8ac35ba31 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:23:58.039171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:23:58.086861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e1add-6373-49cb-bd20-e38993d7a112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:23:58.087495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e1add-6373-49cb-bd20-e38993d7a112 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:23:58.087772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e1add-6373-49cb-bd20-e38993d7a112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:23:58.088041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e1add-6373-49cb-bd20-e38993d7a112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:23:58.089671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ff7e1add-6373-49cb-bd20-e38993d7a112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:23:58.200242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e1add-6373-49cb-bd20-e38993d7a112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:23:58.201624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e1add-6373-49cb-bd20-e38993d7a112 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:23:58.221468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 731/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:00.195200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4695a-2766-4d9a-b59f-6e3df8bbfe1b None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:00.195799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4695a-2766-4d9a-b59f-6e3df8bbfe1b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:00.195799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4695a-2766-4d9a-b59f-6e3df8bbfe1b None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:00.197128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:00.202602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db980a-afb6-4d1f-9e5b-2c46bf1fb356 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:00.203036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db980a-afb6-4d1f-9e5b-2c46bf1fb356 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:00.203150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db980a-afb6-4d1f-9e5b-2c46bf1fb356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:00.269457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-95db980a-afb6-4d1f-9e5b-2c46bf1fb356 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:00.271345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-95db980a-afb6-4d1f-9e5b-2c46bf1fb356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:00.279987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:00.371149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:00.658268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4695a-2766-4d9a-b59f-6e3df8bbfe1b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:00.659842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b0a4695a-2766-4d9a-b59f-6e3df8bbfe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:00.764504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4695a-2766-4d9a-b59f-6e3df8bbfe1b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:00.820619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:00.840075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08d4ca-f7a3-4cb5-bce7-c7cd0a343a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:00.840694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08d4ca-f7a3-4cb5-bce7-c7cd0a343a80 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:00.840972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08d4ca-f7a3-4cb5-bce7-c7cd0a343a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:00.841265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08d4ca-f7a3-4cb5-bce7-c7cd0a343a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:00.842896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fc08d4ca-f7a3-4cb5-bce7-c7cd0a343a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:00.954970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08d4ca-f7a3-4cb5-bce7-c7cd0a343a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:00.956562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08d4ca-f7a3-4cb5-bce7-c7cd0a343a80 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:00.977252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 729/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:02.946398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab5d30-4212-4cdb-bd40-32e3cffe5724 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:02.946969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab5d30-4212-4cdb-bd40-32e3cffe5724 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:02.946969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab5d30-4212-4cdb-bd40-32e3cffe5724 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:02.948312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:02.953907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63824c-f47b-479c-ae8e-fadaf859353e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:02.954397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63824c-f47b-479c-ae8e-fadaf859353e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:02.954501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63824c-f47b-479c-ae8e-fadaf859353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:03.142919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-fd63824c-f47b-479c-ae8e-fadaf859353e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:03.144074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fd63824c-f47b-479c-ae8e-fadaf859353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:03.182662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:03.242948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:03.527811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab5d30-4212-4cdb-bd40-32e3cffe5724 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:03.529402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-48ab5d30-4212-4cdb-bd40-32e3cffe5724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:03.636399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab5d30-4212-4cdb-bd40-32e3cffe5724 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:03.679059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:03.715299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c514e-ca85-4e3e-97a1-7c0d5ca4abd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:03.715894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c514e-ca85-4e3e-97a1-7c0d5ca4abd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:03.716167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c514e-ca85-4e3e-97a1-7c0d5ca4abd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:03.716429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c514e-ca85-4e3e-97a1-7c0d5ca4abd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:03.718040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-863c514e-ca85-4e3e-97a1-7c0d5ca4abd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:03.827051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c514e-ca85-4e3e-97a1-7c0d5ca4abd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:03.828404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c514e-ca85-4e3e-97a1-7c0d5ca4abd1 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:03.847174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 734/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:05.809919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6fce-6dbd-44c1-a906-9d5211b6a92d None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:05.810504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6fce-6dbd-44c1-a906-9d5211b6a92d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:05.810504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6fce-6dbd-44c1-a906-9d5211b6a92d None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:05.811805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:05.817229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b370d-c085-4281-be56-2d906a552f2e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:05.818298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b370d-c085-4281-be56-2d906a552f2e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:05.818406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b370d-c085-4281-be56-2d906a552f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:05.885814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ed8b370d-c085-4281-be56-2d906a552f2e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:05.887088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ed8b370d-c085-4281-be56-2d906a552f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:05.905007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:05.983731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:06.263618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6fce-6dbd-44c1-a906-9d5211b6a92d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:06.265259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9e2d6fce-6dbd-44c1-a906-9d5211b6a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:06.369268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6fce-6dbd-44c1-a906-9d5211b6a92d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:06.437812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:06.444841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56256bb4-bec4-42ab-b86c-7135b0ce0dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:06.448527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56256bb4-bec4-42ab-b86c-7135b0ce0dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:06.448527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56256bb4-bec4-42ab-b86c-7135b0ce0dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:06.448527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56256bb4-bec4-42ab-b86c-7135b0ce0dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:06.448527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-56256bb4-bec4-42ab-b86c-7135b0ce0dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:06.559043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56256bb4-bec4-42ab-b86c-7135b0ce0dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:06.560389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56256bb4-bec4-42ab-b86c-7135b0ce0dc1 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:06.578752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 732/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:08.511026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80870a-3e59-4c2e-b239-e01aa4d7ae55 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:08.511626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80870a-3e59-4c2e-b239-e01aa4d7ae55 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:08.511626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80870a-3e59-4c2e-b239-e01aa4d7ae55 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:08.512896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:08.518251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd43a5-2d11-414a-a2c3-1d960282e966 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:08.518688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd43a5-2d11-414a-a2c3-1d960282e966 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:08.518818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd43a5-2d11-414a-a2c3-1d960282e966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:08.586366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-73bd43a5-2d11-414a-a2c3-1d960282e966 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:08.587525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-73bd43a5-2d11-414a-a2c3-1d960282e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:08.637474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:08.686131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:08.971944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80870a-3e59-4c2e-b239-e01aa4d7ae55 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:08.973533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ef80870a-3e59-4c2e-b239-e01aa4d7ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:09.081952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80870a-3e59-4c2e-b239-e01aa4d7ae55 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:09.131491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:09.157109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d19b1-c83b-4575-9dbb-ee1ba0a5f976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:09.157742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d19b1-c83b-4575-9dbb-ee1ba0a5f976 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:09.158016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d19b1-c83b-4575-9dbb-ee1ba0a5f976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:09.158281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d19b1-c83b-4575-9dbb-ee1ba0a5f976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:09.159860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d81d19b1-c83b-4575-9dbb-ee1ba0a5f976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:09.271547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d19b1-c83b-4575-9dbb-ee1ba0a5f976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:09.272988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d19b1-c83b-4575-9dbb-ee1ba0a5f976 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:09.290744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 737/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:18.687013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=22 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:19.289554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=66 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:29.025375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d714c0-aae3-478a-b771-109294c70c25 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:29.025917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d714c0-aae3-478a-b771-109294c70c25 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:29.025917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d714c0-aae3-478a-b771-109294c70c25 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:29.027264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 734/1471] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:29.032776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20471-a7c4-45c0-9eef-14aaf539dada None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:29.034218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20471-a7c4-45c0-9eef-14aaf539dada None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:29.034218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20471-a7c4-45c0-9eef-14aaf539dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:29.100428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0fd20471-a7c4-45c0-9eef-14aaf539dada None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:29.101661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0fd20471-a7c4-45c0-9eef-14aaf539dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:29.201030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 738/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:29.502899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214387-7013-452c-9c2c-ba0edb69a233 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:29.503208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214387-7013-452c-9c2c-ba0edb69a233 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:29.503487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214387-7013-452c-9c2c-ba0edb69a233 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:29.505351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 735/1473] 10.222.0.50 () {54 vars in 967 bytes} [Mon Aug 29 21:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:29.510506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280a92-fbba-4314-a25b-1b04479cbb8f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:29.510792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280a92-fbba-4314-a25b-1b04479cbb8f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:29.511065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280a92-fbba-4314-a25b-1b04479cbb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:29.592263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-58280a92-fbba-4314-a25b-1b04479cbb8f None None] MFA Rules not processed for user `b56b3fafca1e47f88482bf25a77a0fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:29.593520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-58280a92-fbba-4314-a25b-1b04479cbb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:29.615095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:29.673699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 739/1474] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Aug 29 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:24:29.683697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214387-7013-452c-9c2c-ba0edb69a233 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:29.683697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3d214387-7013-452c-9c2c-ba0edb69a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:29.791523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214387-7013-452c-9c2c-ba0edb69a233 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:29.867685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba40c7-e576-4106-8d52-5827236b1733 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:29.868299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba40c7-e576-4106-8d52-5827236b1733 service glance] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:29.868580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba40c7-e576-4106-8d52-5827236b1733 service glance] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:29.868853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba40c7-e576-4106-8d52-5827236b1733 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:29.870498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b8ba40c7-e576-4106-8d52-5827236b1733 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:29.925790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:29.984929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba40c7-e576-4106-8d52-5827236b1733 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:29.986406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba40c7-e576-4106-8d52-5827236b1733 service glance] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:30.005211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 736/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:32.052963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdf2d-3181-41ba-9d8d-93958adfbc44 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:32.053563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdf2d-3181-41ba-9d8d-93958adfbc44 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:32.053563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdf2d-3181-41ba-9d8d-93958adfbc44 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:32.054953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 740/1476] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:24:32.060758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0e78-c266-4c74-9f14-51213dcb6679 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:32.061422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0e78-c266-4c74-9f14-51213dcb6679 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:32.061422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0e78-c266-4c74-9f14-51213dcb6679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:32.134975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-c30d0e78-c266-4c74-9f14-51213dcb6679 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:32.136226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c30d0e78-c266-4c74-9f14-51213dcb6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:32.239765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 737/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:32.514215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfdf2d-3181-41ba-9d8d-93958adfbc44 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:32.515676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5bcfdf2d-3181-41ba-9d8d-93958adfbc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:32.646217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfdf2d-3181-41ba-9d8d-93958adfbc44 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:32.699489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:32.744902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33264aa6-1e32-4c34-bd7e-87de38dee9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:32.745541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33264aa6-1e32-4c34-bd7e-87de38dee9be admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:32.745824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33264aa6-1e32-4c34-bd7e-87de38dee9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:32.746096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33264aa6-1e32-4c34-bd7e-87de38dee9be admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:32.746736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33264aa6-1e32-4c34-bd7e-87de38dee9be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:32.748501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-33264aa6-1e32-4c34-bd7e-87de38dee9be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:24:32.748501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:24:32.748501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:24:32.749670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33264aa6-1e32-4c34-bd7e-87de38dee9be admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:32.768420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 741/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:32 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:24:34.709191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126de4-3d8a-4cb2-8d01-dcba01c9364d None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:34.709931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126de4-3d8a-4cb2-8d01-dcba01c9364d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:34.709931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126de4-3d8a-4cb2-8d01-dcba01c9364d None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:34.711097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 738/1479] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:24:34.716268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce52c-2a52-4cdf-b297-ccde7ab23359 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:34.716727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce52c-2a52-4cdf-b297-ccde7ab23359 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:34.716833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce52c-2a52-4cdf-b297-ccde7ab23359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:34.782221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-801ce52c-2a52-4cdf-b297-ccde7ab23359 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:34.783406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-801ce52c-2a52-4cdf-b297-ccde7ab23359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:34.879610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 742/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:35.172168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126de4-3d8a-4cb2-8d01-dcba01c9364d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:35.173825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2e126de4-3d8a-4cb2-8d01-dcba01c9364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:35.184226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:35.331250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126de4-3d8a-4cb2-8d01-dcba01c9364d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:35.413360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:35.447329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9211-4830-41ad-b0a2-1859c25495ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:35.447937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9211-4830-41ad-b0a2-1859c25495ad service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:35.448218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9211-4830-41ad-b0a2-1859c25495ad service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:35.448491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9211-4830-41ad-b0a2-1859c25495ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:35.450208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-966d9211-4830-41ad-b0a2-1859c25495ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:35.539726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d9211-4830-41ad-b0a2-1859c25495ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:35.541341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d9211-4830-41ad-b0a2-1859c25495ad service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:35.559982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 739/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:37.679230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90137b68-a20b-4bb2-b3f1-def569841820 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:37.679886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90137b68-a20b-4bb2-b3f1-def569841820 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:37.679886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90137b68-a20b-4bb2-b3f1-def569841820 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:37.681157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 743/1482] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:37.686651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c606d-6705-453d-bbf2-8fa974fb4b74 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:37.687134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c606d-6705-453d-bbf2-8fa974fb4b74 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:37.687244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c606d-6705-453d-bbf2-8fa974fb4b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:37.756209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3f8c606d-6705-453d-bbf2-8fa974fb4b74 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:37.757497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3f8c606d-6705-453d-bbf2-8fa974fb4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:37.804490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:37.861115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 740/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:38.148706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90137b68-a20b-4bb2-b3f1-def569841820 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:38.150297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-90137b68-a20b-4bb2-b3f1-def569841820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:38.175133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:38.260383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90137b68-a20b-4bb2-b3f1-def569841820 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:38.342282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747385c-7922-490c-a99d-07f2b20ffa16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:38.342891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747385c-7922-490c-a99d-07f2b20ffa16 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:38.343171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747385c-7922-490c-a99d-07f2b20ffa16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:38.343444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747385c-7922-490c-a99d-07f2b20ffa16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:38.345095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6747385c-7922-490c-a99d-07f2b20ffa16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:38.423340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:38.459827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747385c-7922-490c-a99d-07f2b20ffa16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:38.461392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747385c-7922-490c-a99d-07f2b20ffa16 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:38.480103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 744/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:40.488198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2ccf-02fe-4be5-b84f-7f4f0adf8602 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:40.489977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2ccf-02fe-4be5-b84f-7f4f0adf8602 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:40.489977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2ccf-02fe-4be5-b84f-7f4f0adf8602 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:40.490485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 741/1485] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:40.495588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177a9a3-3e07-4d83-aeb1-950b634a56e6 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:40.496072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177a9a3-3e07-4d83-aeb1-950b634a56e6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:40.496184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177a9a3-3e07-4d83-aeb1-950b634a56e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:40.563017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b177a9a3-3e07-4d83-aeb1-950b634a56e6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:40.564234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b177a9a3-3e07-4d83-aeb1-950b634a56e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:40.664293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 745/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:40.952473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a2ccf-02fe-4be5-b84f-7f4f0adf8602 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:40.954058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d18a2ccf-02fe-4be5-b84f-7f4f0adf8602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:41.065258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a2ccf-02fe-4be5-b84f-7f4f0adf8602 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:41.140017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:41.141814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb5ae3-e958-4d90-bc06-3856a859bb52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:41.142430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5ae3-e958-4d90-bc06-3856a859bb52 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:41.142713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5ae3-e958-4d90-bc06-3856a859bb52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:41.143004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5ae3-e958-4d90-bc06-3856a859bb52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:41.145140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ffeb5ae3-e958-4d90-bc06-3856a859bb52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:41.255781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb5ae3-e958-4d90-bc06-3856a859bb52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:41.257244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb5ae3-e958-4d90-bc06-3856a859bb52 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:41.275541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 742/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:43.386836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee912b4-d4e5-4a1b-858e-7848b2f41a4d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.387396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee912b4-d4e5-4a1b-858e-7848b2f41a4d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.387396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee912b4-d4e5-4a1b-858e-7848b2f41a4d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.388772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 746/1488] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:43.394664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f960c4-44a8-46ac-b55b-c815eb9cae76 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.395215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f960c4-44a8-46ac-b55b-c815eb9cae76 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.395215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f960c4-44a8-46ac-b55b-c815eb9cae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.467226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b4f960c4-44a8-46ac-b55b-c815eb9cae76 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:43.468465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b4f960c4-44a8-46ac-b55b-c815eb9cae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:43.524901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.570846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 743/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:24:43.867627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee912b4-d4e5-4a1b-858e-7848b2f41a4d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.869203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9ee912b4-d4e5-4a1b-858e-7848b2f41a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:43.904483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.973282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee912b4-d4e5-4a1b-858e-7848b2f41a4d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:44.046257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54c487-0dd5-469d-ab7c-4cf70055ed52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:44.046859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c487-0dd5-469d-ab7c-4cf70055ed52 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:44.047133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c487-0dd5-469d-ab7c-4cf70055ed52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:44.047395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c487-0dd5-469d-ab7c-4cf70055ed52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:44.049010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7c54c487-0dd5-469d-ab7c-4cf70055ed52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:44.134699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:44.165440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54c487-0dd5-469d-ab7c-4cf70055ed52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:44.166916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54c487-0dd5-469d-ab7c-4cf70055ed52 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:44.185610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 747/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:46.523375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6490e-02ed-4174-b983-80678f5e70b3 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:46.523949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6490e-02ed-4174-b983-80678f5e70b3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:46.523949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6490e-02ed-4174-b983-80678f5e70b3 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:46.525431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 744/1491] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 21:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:46.530594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde369b-e5eb-430d-99f8-893352998622 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:46.531028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde369b-e5eb-430d-99f8-893352998622 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:46.531125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde369b-e5eb-430d-99f8-893352998622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:46.602263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7dde369b-e5eb-430d-99f8-893352998622 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:46.603490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7dde369b-e5eb-430d-99f8-893352998622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:46.702916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 748/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:24:46.989784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6490e-02ed-4174-b983-80678f5e70b3 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:46.991445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c9b6490e-02ed-4174-b983-80678f5e70b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:47.098789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6490e-02ed-4174-b983-80678f5e70b3 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:47.175616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f177cd-e4c6-4e54-ad59-b519e0effcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:47.176173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f177cd-e4c6-4e54-ad59-b519e0effcec service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.176457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f177cd-e4c6-4e54-ad59-b519e0effcec service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.176728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f177cd-e4c6-4e54-ad59-b519e0effcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.178750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e8f177cd-e4c6-4e54-ad59-b519e0effcec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:47.188160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:47.295029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f177cd-e4c6-4e54-ad59-b519e0effcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:47.296461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f177cd-e4c6-4e54-ad59-b519e0effcec service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:47.315278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 745/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:24:56.701185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=82 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:57.312934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=50 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:11.829083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.829676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.829793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.909687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:11.910950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:12.012849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 749/1494] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:26:12.021142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299146f7-9458-4e03-b904-b4854915b243 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.021686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299146f7-9458-4e03-b904-b4854915b243 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.021686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299146f7-9458-4e03-b904-b4854915b243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.103381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-299146f7-9458-4e03-b904-b4854915b243 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:12.104606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-299146f7-9458-4e03-b904-b4854915b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:12.208039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 746/1495] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:26:12.212727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.213989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:12.226324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db81f2-2c7a-4617-91e4-7b4100c9396c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.289260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.326914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.327627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.330696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.330696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.330696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:12.330696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.330696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:12.330696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:26:12.330696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:26:12.331449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.343413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 750/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:12.352429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299146f7-9458-4e03-b904-b4854915b243 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.362534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299146f7-9458-4e03-b904-b4854915b243 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.432277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.470526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.471153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.471588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.471861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.472509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.474313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING py.warnings [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:12.474313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: warnings.warn(msg) Aug 29 21:26:12.474313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: Aug 29 21:26:12.475525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.651047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 747/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:26:12 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:12.655308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.656824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:12.690579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d2b7-f2e2-4af2-8de9-10bd1af958b5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.793556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.794163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.794443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.794713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.795352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.796362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:12.796362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:26:12.796362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:26:12.798137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.949327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 751/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:26:12 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:12.954241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.955811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:13.028717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c1d71-044a-4866-ab30-c2dd871babbe admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.136104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.152851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.152851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.152851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.153681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.153681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.154679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING py.warnings [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:13.154679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: warnings.warn(msg) Aug 29 21:26:13.154679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: Aug 29 21:26:13.155585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.169456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 748/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:26:13.175425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.176977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:13.190148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597621f6-4e3c-44d8-9002-6bfa9ef92473 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.218386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.294126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863b0f-f2e1-4cc8-bf40-73dd0fb227c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.294755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863b0f-f2e1-4cc8-bf40-73dd0fb227c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.295059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863b0f-f2e1-4cc8-bf40-73dd0fb227c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.295328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863b0f-f2e1-4cc8-bf40-73dd0fb227c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.296029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02863b0f-f2e1-4cc8-bf40-73dd0fb227c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.297725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-02863b0f-f2e1-4cc8-bf40-73dd0fb227c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:13.297725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:26:13.297725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:26:13.298583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02863b0f-f2e1-4cc8-bf40-73dd0fb227c0 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.312520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 752/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:26:13.318378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.319965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:13.361361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c5913-57ef-46e7-bb20-f18c18d4c9e7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.461819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98191-6a68-4380-9ea5-493dfa9d9802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.462484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98191-6a68-4380-9ea5-493dfa9d9802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.462767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98191-6a68-4380-9ea5-493dfa9d9802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.463042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98191-6a68-4380-9ea5-493dfa9d9802 admin admin] PATH_INFO: `/v3/projects/74e788baca1945fa83df286a1890001e/users/76217af8a8dd4fdcad724d03423fbf92/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.486787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98191-6a68-4380-9ea5-493dfa9d9802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e788baca1945fa83df286a1890001e, user_id=76217af8a8dd4fdcad724d03423fbf92, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.487834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING py.warnings [None req-72b98191-6a68-4380-9ea5-493dfa9d9802 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:13.487834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: warnings.warn(msg) Aug 29 21:26:13.487834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: Aug 29 21:26:13.489847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98191-6a68-4380-9ea5-493dfa9d9802 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.629160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 749/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:26:13 2022] PUT /identity/v3/projects/74e788baca1945fa83df286a1890001e/users/76217af8a8dd4fdcad724d03423fbf92/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:13.642140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f5e59-5dc1-4b38-9e30-3bec0a573e69 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.642392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f5e59-5dc1-4b38-9e30-3bec0a573e69 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.642522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f5e59-5dc1-4b38-9e30-3bec0a573e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.702336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-fe0f5e59-5dc1-4b38-9e30-3bec0a573e69 None None] MFA Rules not processed for user `76217af8a8dd4fdcad724d03423fbf92`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:13.703600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-fe0f5e59-5dc1-4b38-9e30-3bec0a573e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:13.786563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 753/1502] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:26:13.800556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3d8d-ec6a-4198-8b49-cbe204fb1cb1 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.800842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3d8d-ec6a-4198-8b49-cbe204fb1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.801150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3d8d-ec6a-4198-8b49-cbe204fb1cb1 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.802504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 750/1503] 10.222.0.50 () {54 vars in 964 bytes} [Mon Aug 29 21:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:13.807458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834d141-ccc3-4b98-9089-df82520532fe None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.807740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834d141-ccc3-4b98-9089-df82520532fe None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.808012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834d141-ccc3-4b98-9089-df82520532fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.841670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.895622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f834d141-ccc3-4b98-9089-df82520532fe None None] MFA Rules not processed for user `01d2e6366b3c488c8b893584f59a98db`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:13.896852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f834d141-ccc3-4b98-9089-df82520532fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:13.981574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 754/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Aug 29 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:26:13.989882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3d8d-ec6a-4198-8b49-cbe204fb1cb1 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.991421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9cab3d8d-ec6a-4198-8b49-cbe204fb1cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:14.045748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:14.104913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3d8d-ec6a-4198-8b49-cbe204fb1cb1 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.183747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.184347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.184631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.184893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.186655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:14.288827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:14.290297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.293889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:14.310796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 751/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:26:14.355226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf3f6b-f3bc-4ed0-b6f8-80967c6986f6 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.355513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf3f6b-f3bc-4ed0-b6f8-80967c6986f6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.355786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf3f6b-f3bc-4ed0-b6f8-80967c6986f6 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.357033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 755/1506] 10.222.0.50 () {52 vars in 830 bytes} [Mon Aug 29 21:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:14.361936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.363197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:14.462579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00d76-1a13-4c86-8ead-e9899ce6af1a service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.558630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.559263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.559539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.559808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] PATH_INFO: `/v3/users/76217af8a8dd4fdcad724d03423fbf92` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.573648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76217af8a8dd4fdcad724d03423fbf92)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:14.574587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING py.warnings [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:14.574587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: warnings.warn(msg) Aug 29 21:26:14.574587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: Aug 29 21:26:14.575822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.586736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:14.865941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76217af8a8dd4fdcad724d03423fbf92'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:14.889941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76217af8a8dd4fdcad724d03423fbf92'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:14.905019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76217af8a8dd4fdcad724d03423fbf92'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:14.975458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76217af8a8dd4fdcad724d03423fbf92'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:14.976240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76217af8a8dd4fdcad724d03423fbf92'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:14.985808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 752/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:26:14 2022] DELETE /identity/v3/users/76217af8a8dd4fdcad724d03423fbf92 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:14.990379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.990903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.991003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.050727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:15.051959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:15.131567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:15.145159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 756/1508] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:26:15.154854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:15.156253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:15.258140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5613ee-5d1c-4ae5-bc62-b0a482489918 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:15.316222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:15.337594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86830f2-2574-4c0a-a167-68c433d76119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:15.338217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86830f2-2574-4c0a-a167-68c433d76119 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.338497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86830f2-2574-4c0a-a167-68c433d76119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.338773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86830f2-2574-4c0a-a167-68c433d76119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.340476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e86830f2-2574-4c0a-a167-68c433d76119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:15.467489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86830f2-2574-4c0a-a167-68c433d76119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:15.468868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86830f2-2574-4c0a-a167-68c433d76119 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:15.488154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 753/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:26:15.983286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:15.985136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:15.998416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1924-4f49-4f86-82c7-9516d3ce6c50 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.104720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.105392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.105679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.105947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] PATH_INFO: `/v3/projects/74e788baca1945fa83df286a1890001e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.119651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e788baca1945fa83df286a1890001e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:16.120693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:26:16.120693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:26:16.120693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:26:16.121970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:16.273568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e788baca1945fa83df286a1890001e', 'request_id': 'req-85b2fc27-8b5f-49e5-a514-1eebe6013206'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:16.352334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e788baca1945fa83df286a1890001e', 'request_id': 'req-85b2fc27-8b5f-49e5-a514-1eebe6013206'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:16.359632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e788baca1945fa83df286a1890001e', 'request_id': 'req-85b2fc27-8b5f-49e5-a514-1eebe6013206'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:16.396727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] The token cache is being invalidate because project 74e788baca1945fa83df286a1890001e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:26:16.397025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:16.397502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-85b2fc27-8b5f-49e5-a514-1eebe6013206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:26:16.399173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 757/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:26:15 2022] DELETE /identity/v3/projects/74e788baca1945fa83df286a1890001e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:25.485993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=62 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:26.394702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:57.158861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd13f-600e-45a8-bcb6-f4943af15976 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.159439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd13f-600e-45a8-bcb6-f4943af15976 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.159439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd13f-600e-45a8-bcb6-f4943af15976 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.160846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:57.166521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9954b4-9350-49c9-a652-3572eb943afe None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.167050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9954b4-9350-49c9-a652-3572eb943afe None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.167146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9954b4-9350-49c9-a652-3572eb943afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.268522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0d9954b4-9350-49c9-a652-3572eb943afe None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:57.271328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0d9954b4-9350-49c9-a652-3572eb943afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:57.387164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:27:57.543328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd13f-600e-45a8-bcb6-f4943af15976 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.546096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-313fd13f-600e-45a8-bcb6-f4943af15976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:57.704973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd13f-600e-45a8-bcb6-f4943af15976 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.714951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0457a-9300-4a51-84ac-d62987da7a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.715858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0457a-9300-4a51-84ac-d62987da7a0b service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.716098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0457a-9300-4a51-84ac-d62987da7a0b service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.716482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0457a-9300-4a51-84ac-d62987da7a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.730051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0457a-9300-4a51-84ac-d62987da7a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.731680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0457a-9300-4a51-84ac-d62987da7a0b service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.744394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 755/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:58.605844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe914-67dc-46a1-9102-45a27e13bad5 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.606379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe914-67dc-46a1-9102-45a27e13bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.606379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe914-67dc-46a1-9102-45a27e13bad5 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.607729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:58.613233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c54a8-bd36-41b1-8961-9cebfbdd5421 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.613774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c54a8-bd36-41b1-8961-9cebfbdd5421 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.613872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c54a8-bd36-41b1-8961-9cebfbdd5421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.634039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2d6c54a8-bd36-41b1-8961-9cebfbdd5421 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:58.635253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2d6c54a8-bd36-41b1-8961-9cebfbdd5421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:58.644192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:27:58.796086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbe914-67dc-46a1-9102-45a27e13bad5 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:58.811151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbe914-67dc-46a1-9102-45a27e13bad5 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.817145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0523a6b-a1fa-4875-97be-37d219617587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:58.817768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0523a6b-a1fa-4875-97be-37d219617587 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.818068 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0523a6b-a1fa-4875-97be-37d219617587 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.818344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0523a6b-a1fa-4875-97be-37d219617587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.828142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0523a6b-a1fa-4875-97be-37d219617587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:58.829780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0523a6b-a1fa-4875-97be-37d219617587 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:58.840890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 760/1516] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:59.462291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470300be-35a5-4189-ab4f-b3ac4050b7f5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.462629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470300be-35a5-4189-ab4f-b3ac4050b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.462841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470300be-35a5-4189-ab4f-b3ac4050b7f5 None None] PATH_INFO: `/v3` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.464140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 757/1517] 10.222.0.57 () {54 vars in 925 bytes} [Mon Aug 29 21:27:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:59.473468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d6739-e6ff-4d4c-9f08-ee7aad44447d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.473757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d6739-e6ff-4d4c-9f08-ee7aad44447d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.474051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d6739-e6ff-4d4c-9f08-ee7aad44447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.550684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-491d6739-e6ff-4d4c-9f08-ee7aad44447d None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:59.552825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-491d6739-e6ff-4d4c-9f08-ee7aad44447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:59.584324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:59.671069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 761/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Aug 29 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:28:08.629089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=56 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:09.673372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=23 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:10.107611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3d71-7579-42ec-bb3f-1c4653550936 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.108248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3d71-7579-42ec-bb3f-1c4653550936 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.108248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3d71-7579-42ec-bb3f-1c4653550936 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.109567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 758/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:10.115214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956db11-5bac-4b4b-8512-61f578057bea None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.124644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956db11-5bac-4b4b-8512-61f578057bea None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.124644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956db11-5bac-4b4b-8512-61f578057bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.150040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9956db11-5bac-4b4b-8512-61f578057bea None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:10.156692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9956db11-5bac-4b4b-8512-61f578057bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:10.167205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 762/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:28:10.328109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3d71-7579-42ec-bb3f-1c4653550936 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:10.357486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3d71-7579-42ec-bb3f-1c4653550936 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:10.366584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14338527-752d-4ae0-afa5-e467fb2604c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:10.370504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14338527-752d-4ae0-afa5-e467fb2604c1 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.370504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14338527-752d-4ae0-afa5-e467fb2604c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.370504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14338527-752d-4ae0-afa5-e467fb2604c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.385178 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14338527-752d-4ae0-afa5-e467fb2604c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:10.388248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14338527-752d-4ae0-afa5-e467fb2604c1 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:10.406004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 759/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:28:10.459035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7991-d522-42d1-be93-496d8c776aed None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.459412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7991-d522-42d1-be93-496d8c776aed None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.459758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7991-d522-42d1-be93-496d8c776aed None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.461527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 763/1522] 10.222.0.50 () {54 vars in 961 bytes} [Mon Aug 29 21:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:10.467619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd43c-45b6-4fee-a162-2e2c8c4065f0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.467997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd43c-45b6-4fee-a162-2e2c8c4065f0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.468344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd43c-45b6-4fee-a162-2e2c8c4065f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.491391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-0c8cd43c-45b6-4fee-a162-2e2c8c4065f0 None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:10.492722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0c8cd43c-45b6-4fee-a162-2e2c8c4065f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:10.502813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 760/1523] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Aug 29 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:28:10.511073 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7991-d522-42d1-be93-496d8c776aed None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:10.528909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7991-d522-42d1-be93-496d8c776aed None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:10.553833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c15a7-b905-421c-9f50-21300d494910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:10.553833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c15a7-b905-421c-9f50-21300d494910 service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.553833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c15a7-b905-421c-9f50-21300d494910 service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.553833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c15a7-b905-421c-9f50-21300d494910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.554478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c15a7-b905-421c-9f50-21300d494910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:10.554478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c15a7-b905-421c-9f50-21300d494910 service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:10.561428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 764/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:28:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:28:11.323298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970dcfd-6388-4c05-8706-7d750e7b2b91 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.323900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970dcfd-6388-4c05-8706-7d750e7b2b91 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.324333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970dcfd-6388-4c05-8706-7d750e7b2b91 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.326998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:28:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:11.335521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa026-a352-4cc2-8fe1-5f378c77bef6 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.336355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa026-a352-4cc2-8fe1-5f378c77bef6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.336355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa026-a352-4cc2-8fe1-5f378c77bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.360247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-3abaa026-a352-4cc2-8fe1-5f378c77bef6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:11.364154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3abaa026-a352-4cc2-8fe1-5f378c77bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:11.372953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:28:11.534884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970dcfd-6388-4c05-8706-7d750e7b2b91 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:11.553198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970dcfd-6388-4c05-8706-7d750e7b2b91 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:11.559597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c80cb-8885-489c-9ad9-bb64ba2a943f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:11.560276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c80cb-8885-489c-9ad9-bb64ba2a943f service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.560553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c80cb-8885-489c-9ad9-bb64ba2a943f service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.560829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c80cb-8885-489c-9ad9-bb64ba2a943f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.570380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c80cb-8885-489c-9ad9-bb64ba2a943f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:11.572111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c80cb-8885-489c-9ad9-bb64ba2a943f service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:11.582668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 762/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:28:15.619951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42455c62-108b-46b8-9496-6889eab41f1f None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.621673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42455c62-108b-46b8-9496-6889eab41f1f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.621673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42455c62-108b-46b8-9496-6889eab41f1f None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.621970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:15.629876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae796-ee79-4558-8009-435e0df613dc None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.630456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae796-ee79-4558-8009-435e0df613dc None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.630456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae796-ee79-4558-8009-435e0df613dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.651390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-eb4ae796-ee79-4558-8009-435e0df613dc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:15.652627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-eb4ae796-ee79-4558-8009-435e0df613dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:15.660978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:28:15.958451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42455c62-108b-46b8-9496-6889eab41f1f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:15.960538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-42455c62-108b-46b8-9496-6889eab41f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:16.057306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42455c62-108b-46b8-9496-6889eab41f1f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:16.061110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3db5d-05d8-4a8a-828f-cc7647d50a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:16.061723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3db5d-05d8-4a8a-828f-cc7647d50a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.062001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3db5d-05d8-4a8a-828f-cc7647d50a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.062275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3db5d-05d8-4a8a-828f-cc7647d50a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.072384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3db5d-05d8-4a8a-828f-cc7647d50a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:16.073862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3db5d-05d8-4a8a-828f-cc7647d50a95 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:16.084088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 767/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:28:18.092364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfd40-492e-4a56-804b-1850dcb6adc9 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.093003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfd40-492e-4a56-804b-1850dcb6adc9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.093003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfd40-492e-4a56-804b-1850dcb6adc9 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.094245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:18.100580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0744a-1561-4094-8060-dec3d65ff118 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.101205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0744a-1561-4094-8060-dec3d65ff118 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.101205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0744a-1561-4094-8060-dec3d65ff118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.124540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c0b0744a-1561-4094-8060-dec3d65ff118 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:18.125857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c0b0744a-1561-4094-8060-dec3d65ff118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:18.134368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:28:18.428959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfd40-492e-4a56-804b-1850dcb6adc9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.430804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-40adfd40-492e-4a56-804b-1850dcb6adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:18.445562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfd40-492e-4a56-804b-1850dcb6adc9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.449248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684729d-84e7-4fba-a91a-7f3063dd3d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.449894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684729d-84e7-4fba-a91a-7f3063dd3d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.450736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684729d-84e7-4fba-a91a-7f3063dd3d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.451018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684729d-84e7-4fba-a91a-7f3063dd3d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.461515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684729d-84e7-4fba-a91a-7f3063dd3d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.462967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684729d-84e7-4fba-a91a-7f3063dd3d93 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.474992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 765/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:28:22.195126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1179aa-4dbf-44bd-b520-15aaeac0cd8f None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.195912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1179aa-4dbf-44bd-b520-15aaeac0cd8f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.196070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1179aa-4dbf-44bd-b520-15aaeac0cd8f None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.198612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:28:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:22.209282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75b20-860f-4153-8ed8-28536d61c030 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.209935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75b20-860f-4153-8ed8-28536d61c030 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.210328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75b20-860f-4153-8ed8-28536d61c030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.235269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1db75b20-860f-4153-8ed8-28536d61c030 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:22.236587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1db75b20-860f-4153-8ed8-28536d61c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:22.245109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:28:22.831657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1179aa-4dbf-44bd-b520-15aaeac0cd8f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:22.834289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-be1179aa-4dbf-44bd-b520-15aaeac0cd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:22.933552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1179aa-4dbf-44bd-b520-15aaeac0cd8f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:22.938274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e8b59-1ed5-47ce-96c6-e3178abcf8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:22.938910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8b59-1ed5-47ce-96c6-e3178abcf8fd service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.939192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8b59-1ed5-47ce-96c6-e3178abcf8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.939466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8b59-1ed5-47ce-96c6-e3178abcf8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.951788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e8b59-1ed5-47ce-96c6-e3178abcf8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:22.953926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e8b59-1ed5-47ce-96c6-e3178abcf8fd service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:22.968623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 770/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:28:25.192264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62094aa-fc9f-4ce1-bf07-5ebe2c3237a4 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:25.192901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62094aa-fc9f-4ce1-bf07-5ebe2c3237a4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:25.192901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62094aa-fc9f-4ce1-bf07-5ebe2c3237a4 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:25.194104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:25.200497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745bea-e9c6-48e8-9ced-b9dc54f8451a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:25.201096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745bea-e9c6-48e8-9ced-b9dc54f8451a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:25.201501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745bea-e9c6-48e8-9ced-b9dc54f8451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:25.225475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-55745bea-e9c6-48e8-9ced-b9dc54f8451a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:25.226699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-55745bea-e9c6-48e8-9ced-b9dc54f8451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:25.235661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:28:25.821790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62094aa-fc9f-4ce1-bf07-5ebe2c3237a4 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:25.823735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b62094aa-fc9f-4ce1-bf07-5ebe2c3237a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:25.843435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62094aa-fc9f-4ce1-bf07-5ebe2c3237a4 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:25.847654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cadfeb-3a04-4680-b949-88f3365d03b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:25.848270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadfeb-3a04-4680-b949-88f3365d03b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:25.848579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadfeb-3a04-4680-b949-88f3365d03b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:25.848830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadfeb-3a04-4680-b949-88f3365d03b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:25.858990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cadfeb-3a04-4680-b949-88f3365d03b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:25.860665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cadfeb-3a04-4680-b949-88f3365d03b5 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:25.871698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 768/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:28:35.219671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=88 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:35.867573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=33 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:56.925279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef950-c698-4243-b9ea-1ce2a86bbdc0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.926527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef950-c698-4243-b9ea-1ce2a86bbdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.927189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef950-c698-4243-b9ea-1ce2a86bbdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.970316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b3bef950-c698-4243-b9ea-1ce2a86bbdc0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:56.972034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b3bef950-c698-4243-b9ea-1ce2a86bbdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:56.984047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 772/1540] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:56.993856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648eaf-e3f9-47ea-b4ec-927047374471 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.995605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648eaf-e3f9-47ea-b4ec-927047374471 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.996114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648eaf-e3f9-47ea-b4ec-927047374471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.034479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-63648eaf-e3f9-47ea-b4ec-927047374471 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.036342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-63648eaf-e3f9-47ea-b4ec-927047374471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.050756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 769/1541] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.066777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bef950-c698-4243-b9ea-1ce2a86bbdc0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.082253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bef950-c698-4243-b9ea-1ce2a86bbdc0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.091697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5162b89-f327-4973-b6fe-11512c32f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.093240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162b89-f327-4973-b6fe-11512c32f258 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.093821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162b89-f327-4973-b6fe-11512c32f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.094372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162b89-f327-4973-b6fe-11512c32f258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.095382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5162b89-f327-4973-b6fe-11512c32f258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:57.096024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5162b89-f327-4973-b6fe-11512c32f258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.102801 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5162b89-f327-4973-b6fe-11512c32f258 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.120442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 773/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:57.138274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648eaf-e3f9-47ea-b4ec-927047374471 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.155190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648eaf-e3f9-47ea-b4ec-927047374471 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.164818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f85281-2506-44b3-b374-2afd8d7eb063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.166143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85281-2506-44b3-b374-2afd8d7eb063 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.167552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85281-2506-44b3-b374-2afd8d7eb063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.168134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85281-2506-44b3-b374-2afd8d7eb063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.169173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f85281-2506-44b3-b374-2afd8d7eb063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.171664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f85281-2506-44b3-b374-2afd8d7eb063 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.189037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc626b-c012-4fff-b0b8-39e49f0b9a70 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.189733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc626b-c012-4fff-b0b8-39e49f0b9a70 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.190238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc626b-c012-4fff-b0b8-39e49f0b9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.238774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-58dc626b-c012-4fff-b0b8-39e49f0b9a70 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.240512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-58dc626b-c012-4fff-b0b8-39e49f0b9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.255997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 774/1543] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.258526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c60dd-9685-4de0-95d9-855e187cefb5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.259160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c60dd-9685-4de0-95d9-855e187cefb5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.259889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c60dd-9685-4de0-95d9-855e187cefb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.301033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a59c60dd-9685-4de0-95d9-855e187cefb5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.302696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a59c60dd-9685-4de0-95d9-855e187cefb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.317941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 775/1544] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.320548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a852-4ccd-417c-b17a-325af508c284 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.320548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a852-4ccd-417c-b17a-325af508c284 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.320548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a852-4ccd-417c-b17a-325af508c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.354208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b1c8a852-4ccd-417c-b17a-325af508c284 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.356649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b1c8a852-4ccd-417c-b17a-325af508c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.364943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 770/1545] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:57.366335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3c7d-9fc5-4410-b026-c6af7211f064 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.366574 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3c7d-9fc5-4410-b026-c6af7211f064 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.366942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3c7d-9fc5-4410-b026-c6af7211f064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.371986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 776/1546] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.373625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2103-60d1-410b-8628-c28d5824b0f6 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.374128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2103-60d1-410b-8628-c28d5824b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.374625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2103-60d1-410b-8628-c28d5824b0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.414949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e20d2103-60d1-410b-8628-c28d5824b0f6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.416091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3aad3c7d-9fc5-4410-b026-c6af7211f064 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.417566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e20d2103-60d1-410b-8628-c28d5824b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.417714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3aad3c7d-9fc5-4410-b026-c6af7211f064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.505249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 777/1547] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.506233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d2103-60d1-410b-8628-c28d5824b0f6 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.512787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 771/1548] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.513806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3c7d-9fc5-4410-b026-c6af7211f064 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.518861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d2103-60d1-410b-8628-c28d5824b0f6 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.523928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45da8d3-99df-428b-b33c-489280530c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.524565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da8d3-99df-428b-b33c-489280530c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.525023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da8d3-99df-428b-b33c-489280530c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.525364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da8d3-99df-428b-b33c-489280530c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.525549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3c7d-9fc5-4410-b026-c6af7211f064 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.526017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da8d3-99df-428b-b33c-489280530c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.528312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da8d3-99df-428b-b33c-489280530c36 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.531678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.532302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.532569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.532845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.533577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:57.533880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.534941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING py.warnings [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:29:57.534941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: warnings.warn(msg) Aug 29 21:29:57.534941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: Aug 29 21:29:57.535835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041de2a0-5932-4b33-8956-f77c1e536eab admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.550207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 772/1549] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:57.551470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6f20b-4ef9-47cc-9608-3e3a68b83607 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.551761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6f20b-4ef9-47cc-9608-3e3a68b83607 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.552033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6f20b-4ef9-47cc-9608-3e3a68b83607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.579934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-03d6f20b-4ef9-47cc-9608-3e3a68b83607 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.589944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-03d6f20b-4ef9-47cc-9608-3e3a68b83607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.590085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 773/1550] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.591343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24e2b-31c5-4661-b2b5-fef22c106836 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.591629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24e2b-31c5-4661-b2b5-fef22c106836 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.591901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24e2b-31c5-4661-b2b5-fef22c106836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.612180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-96f24e2b-31c5-4661-b2b5-fef22c106836 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.613439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-96f24e2b-31c5-4661-b2b5-fef22c106836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.624326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 774/1551] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.625871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa307f-203d-4636-84b4-4f7ebdd6841c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.626372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa307f-203d-4636-84b4-4f7ebdd6841c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.626860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa307f-203d-4636-84b4-4f7ebdd6841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.650973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 778/1552] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:57.653161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677e92-da67-4edf-9ae9-8a294db04d5a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.653161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677e92-da67-4edf-9ae9-8a294db04d5a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.653729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677e92-da67-4edf-9ae9-8a294db04d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.661003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-74fa307f-203d-4636-84b4-4f7ebdd6841c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.662941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-74fa307f-203d-4636-84b4-4f7ebdd6841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.676918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 775/1553] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.678605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa307f-203d-4636-84b4-4f7ebdd6841c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.678865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b4677e92-da67-4edf-9ae9-8a294db04d5a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.680676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b4677e92-da67-4edf-9ae9-8a294db04d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.691227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 779/1554] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.692380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4677e92-da67-4edf-9ae9-8a294db04d5a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.699235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa307f-203d-4636-84b4-4f7ebdd6841c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.703403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4677e92-da67-4edf-9ae9-8a294db04d5a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.704713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8373c7-17e0-4ed9-8285-5b8e46a04534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.705415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8373c7-17e0-4ed9-8285-5b8e46a04534 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.705672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8373c7-17e0-4ed9-8285-5b8e46a04534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.705928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8373c7-17e0-4ed9-8285-5b8e46a04534 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.706612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8373c7-17e0-4ed9-8285-5b8e46a04534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:57.706920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8373c7-17e0-4ed9-8285-5b8e46a04534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.708544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8373c7-17e0-4ed9-8285-5b8e46a04534 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.708888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98ab6e-3983-4ab2-9f40-fa68d9969154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.709565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98ab6e-3983-4ab2-9f40-fa68d9969154 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.709846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98ab6e-3983-4ab2-9f40-fa68d9969154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.710119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98ab6e-3983-4ab2-9f40-fa68d9969154 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.710753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98ab6e-3983-4ab2-9f40-fa68d9969154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.712131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-ca98ab6e-3983-4ab2-9f40-fa68d9969154 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:29:57.712131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:29:57.712131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:29:57.713705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98ab6e-3983-4ab2-9f40-fa68d9969154 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.721475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 776/1555] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:57.723222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71270653-fe60-4ff4-81b2-dc89941d3f24 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.723511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71270653-fe60-4ff4-81b2-dc89941d3f24 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.723788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71270653-fe60-4ff4-81b2-dc89941d3f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.744489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-71270653-fe60-4ff4-81b2-dc89941d3f24 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.752282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-71270653-fe60-4ff4-81b2-dc89941d3f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.754442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 777/1556] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.755724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd371bb-9e7c-4213-a0d7-0fad15a1b95d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.755994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd371bb-9e7c-4213-a0d7-0fad15a1b95d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.756269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd371bb-9e7c-4213-a0d7-0fad15a1b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.775593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2fd371bb-9e7c-4213-a0d7-0fad15a1b95d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.776827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2fd371bb-9e7c-4213-a0d7-0fad15a1b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.784903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 778/1557] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.786878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd371bb-9e7c-4213-a0d7-0fad15a1b95d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.798171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd371bb-9e7c-4213-a0d7-0fad15a1b95d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.803568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.804194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.804469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.804739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.805415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.807950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.808819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 780/1558] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:57.810528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb5407-891f-4cc6-842f-8ff57bc7a123 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.810996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb5407-891f-4cc6-842f-8ff57bc7a123 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.811302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb5407-891f-4cc6-842f-8ff57bc7a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.823384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 779/1559] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:57.830330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.836065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d0fb4-1426-41b5-8186-c125433584b3 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.845571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8abb5407-891f-4cc6-842f-8ff57bc7a123 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.845571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8abb5407-891f-4cc6-842f-8ff57bc7a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.896054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:57.905880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.907190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.907190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.907190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.908068 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:57.908384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.910042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.911598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 781/1560] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.916408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfdcb0-aa64-497b-9019-35e3d5d6c8ab None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.916408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfdcb0-aa64-497b-9019-35e3d5d6c8ab None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.916408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfdcb0-aa64-497b-9019-35e3d5d6c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.934873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-67bfdcb0-aa64-497b-9019-35e3d5d6c8ab None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:57.936098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-67bfdcb0-aa64-497b-9019-35e3d5d6c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.938968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 780/1561] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:57.941735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.951136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a801ba-b15f-4ce0-805f-932b00fb4450 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.953202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 782/1562] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:57.954055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfdcb0-aa64-497b-9019-35e3d5d6c8ab None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.965628 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfdcb0-aa64-497b-9019-35e3d5d6c8ab None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.966444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.967066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.967341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.967606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.968244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.970358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.971859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.972916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.973536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.973862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.974477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:57.974781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.976418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.980851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:57.992273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 783/1563] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:58.000023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.004511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691ff52-e338-4155-9b4f-ff0493b75437 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.009718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.010392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.010925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.011197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.011976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:58.012281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.013996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.029377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 784/1564] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:58.030287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.043069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d388b-b319-4933-9444-ecdd75253657 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.048131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.061263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.061263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.061263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.061263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.061263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.120143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 781/1565] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:58.121295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.153644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 785/1566] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:58.153644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.165280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a157f-721f-4620-b295-520f5b1fb213 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.204903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1afe49-60e7-4441-8936-0b494edea27b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.211975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.213964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.214325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.214765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.215828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.218694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.234396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 782/1567] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:58.236239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.246313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff1f97-7bab-412c-8d0f-16617d90f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.247478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1f97-7bab-412c-8d0f-16617d90f43f admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.247982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1f97-7bab-412c-8d0f-16617d90f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.248488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1f97-7bab-412c-8d0f-16617d90f43f admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.249718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1f97-7bab-412c-8d0f-16617d90f43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:58.250037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1f97-7bab-412c-8d0f-16617d90f43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.251682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1f97-7bab-412c-8d0f-16617d90f43f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.253274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbbe54-03d5-46f2-8e1b-d6c66e683994 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.262274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.263278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.263775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.264292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.265706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.266900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 786/1568] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:58.268176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959781a-3e09-4c08-a755-1daaf9ffa29f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.268464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959781a-3e09-4c08-a755-1daaf9ffa29f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.268741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959781a-3e09-4c08-a755-1daaf9ffa29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.269270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.294626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c959781a-3e09-4c08-a755-1daaf9ffa29f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:58.295862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c959781a-3e09-4c08-a755-1daaf9ffa29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:58.304730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 787/1569] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:58.308492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959781a-3e09-4c08-a755-1daaf9ffa29f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.315799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959781a-3e09-4c08-a755-1daaf9ffa29f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.320600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.321269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.321553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.321831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.322485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.324967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.411216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 783/1570] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:58.412112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.459983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 788/1571] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:58.459983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.496779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43e8d-0379-4ad6-8896-592890226b18 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.531129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57681-8c48-469b-95ca-6871453174e6 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.536048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.536707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.536984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.537275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.537924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.539871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.555620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:58.569882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.570584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.570874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.571199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.571804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.574338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.628634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 789/1572] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:58.629613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.641006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be5623-ba08-4353-b7eb-026871932c82 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.646005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.646659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.646941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.647209 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.647857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.649513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.660372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 790/1573] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:58.661541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.671843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c77aa-470c-4244-85e1-cb1d0431f5dd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.676972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.677674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.677951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.678224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] PATH_INFO: `/v3/projects/b0c2ee3f7f854fd8b4c193c63c1a203a/users/5ed2e8fb67c5408ebfaa419c04284d94/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.681764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:58.696757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c2ee3f7f854fd8b4c193c63c1a203a, user_id=5ed2e8fb67c5408ebfaa419c04284d94, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.698575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:29:58.698575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:29:58.698575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:29:58.702017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.716709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 784/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:58.716709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.781250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a50b15-a088-4cf4-a103-3aba48009c4f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.786079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.786704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.786974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.787258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.787906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.789913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.800231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 791/1575] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:29:58 2022] PUT /identity/v3/projects/b0c2ee3f7f854fd8b4c193c63c1a203a/users/5ed2e8fb67c5408ebfaa419c04284d94/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:29:58.802481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.893613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2fa13-b44d-4782-8345-4928aa52a494 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.901451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.902088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.902584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.903063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.904322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:58.904859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.907333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.914808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 785/1576] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:58.915950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.932379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 792/1577] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:58.932379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.950998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a915f-7c38-445d-87a0-b3d17522c633 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.993190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a074ff-d1fd-4632-8cdc-d473b07efb65 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.999105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.999729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.000008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.000286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.000935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.002001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING py.warnings [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:29:59.002001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: warnings.warn(msg) Aug 29 21:29:59.002001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: Aug 29 21:29:59.003232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.027810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.028544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.028827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.029133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.029783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.031839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.210082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 786/1578] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:59.210082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.220726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697470-505d-48d8-b4cc-649ab3296079 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.225765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.226425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.226711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.226986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.227662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.229868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.246853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 793/1579] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:59.246853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.247893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 787/1580] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.249371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.261407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971f94-d9b7-416f-8188-f93e9025eb56 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.266118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066db588-12a1-4abc-9b67-eee267d74537 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.266597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfb2b8-62c7-4854-a32b-322ec8e6d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.267249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb2b8-62c7-4854-a32b-322ec8e6d07a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.267530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb2b8-62c7-4854-a32b-322ec8e6d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.267806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb2b8-62c7-4854-a32b-322ec8e6d07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.268464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfb2b8-62c7-4854-a32b-322ec8e6d07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.270208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfb2b8-62c7-4854-a32b-322ec8e6d07a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.274047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.275106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.275619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.276995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.276995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.280456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.284055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 794/1581] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.285576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51174-b803-4b30-84af-fb2948b527b3 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.285887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51174-b803-4b30-84af-fb2948b527b3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.286188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51174-b803-4b30-84af-fb2948b527b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.330990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-26e51174-b803-4b30-84af-fb2948b527b3 None None] MFA Rules not processed for user `5ed2e8fb67c5408ebfaa419c04284d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:59.332245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-26e51174-b803-4b30-84af-fb2948b527b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:59.384105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:59.412655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 788/1582] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:59 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:59.413968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.418385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 795/1583] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:29:59.419950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51174-b803-4b30-84af-fb2948b527b3 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.431567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a1c3-b228-48a3-b2c8-8ac2bba44f93 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.437018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.437706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.440672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.440862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51174-b803-4b30-84af-fb2948b527b3 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.441042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.441042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.441042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.444066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.445031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.445527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.446001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.446744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.450194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.582359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:59.595160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 789/1584] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:59 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:59.595160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.595509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 796/1585] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:29:59 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:59.596083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.609820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c004868-f711-42d6-958c-01ef8e1d683d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.685730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28229-e0f0-4262-90b7-730b58a6f4ba admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.687438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.688287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.688681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.689050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.689904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.690994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.691602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.691748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.691911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.692150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.692826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.694439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.704719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 790/1586] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.709501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.715651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 797/1587] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.715651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.719917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6606-5368-406a-b220-ec7a25742d7d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.724144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281de64-aa91-462d-b2a3-550a65273094 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.724825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.725526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.725836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.726109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] PATH_INFO: `/v3/projects/49e1255c9a2d4b4086c1fecebad74952/users/d5778532fdeb49aa80bebc165208165b/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.734506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.735755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.736271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.736757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.737985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.741209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.744108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e1255c9a2d4b4086c1fecebad74952, user_id=d5778532fdeb49aa80bebc165208165b, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.747177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.756323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 791/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.757431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.773226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499acfc-a8d7-45cc-ae96-a2fb43075d01 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.779412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bbce3-a38f-45c7-a2c5-f4fc6a3f27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.780031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bbce3-a38f-45c7-a2c5-f4fc6a3f27d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.780311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bbce3-a38f-45c7-a2c5-f4fc6a3f27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.780583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bbce3-a38f-45c7-a2c5-f4fc6a3f27d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.781278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bbce3-a38f-45c7-a2c5-f4fc6a3f27d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.782894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bbce3-a38f-45c7-a2c5-f4fc6a3f27d9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.797718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 792/1589] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.797718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858e3c-f97e-4956-876f-e545c94f86d5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.797718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858e3c-f97e-4956-876f-e545c94f86d5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.797718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858e3c-f97e-4956-876f-e545c94f86d5 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.797718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 793/1590] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 21:29:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:59.797718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858e3c-f97e-4956-876f-e545c94f86d5 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.813347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858e3c-f97e-4956-876f-e545c94f86d5 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.820837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.821734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.822413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.823434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.824552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.827403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.845522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 794/1591] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.846174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.858621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c08e8-b51d-49c8-9a20-5a575d6531e8 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.859847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 798/1592] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:29:59 2022] PUT /identity/v3/projects/49e1255c9a2d4b4086c1fecebad74952/users/d5778532fdeb49aa80bebc165208165b/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:29:59.860678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.939312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.939940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.940272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.940553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.941267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.942622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ebd00-92b3-4e3b-be9b-06bac977c197 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.943267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.950911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.951834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.952395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.952763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.953459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.955766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.971781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 799/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:59.972495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.982833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a2751-4f18-4bd0-a178-fad04435d7b9 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.989028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.989664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.989947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.990229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.990954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.992593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.004241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 800/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:00.006635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.016217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247308d-8e49-49e3-b200-b198ccecd8bf admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.021186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.021864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.022146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.022427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] PATH_INFO: `/v3/projects/6b580789dbf641e891ada19a5ca4fc30/users/5db5b6bb121342f5bdbf255ad3da6883/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.038616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 795/1595] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:59 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:00.038616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.043119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b580789dbf641e891ada19a5ca4fc30, user_id=5db5b6bb121342f5bdbf255ad3da6883, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.046815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914e253-a0f6-42a3-931c-0782762c0395 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.047068 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.051192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051252b-219c-417d-8633-eddc795cc336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.052009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051252b-219c-417d-8633-eddc795cc336 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.052291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051252b-219c-417d-8633-eddc795cc336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.052564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051252b-219c-417d-8633-eddc795cc336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.053287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051252b-219c-417d-8633-eddc795cc336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.055002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051252b-219c-417d-8633-eddc795cc336 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.068157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 796/1596] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:00.069577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453257-e42a-439c-b644-163439fcbd62 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.069875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453257-e42a-439c-b644-163439fcbd62 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.070238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453257-e42a-439c-b644-163439fcbd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.112426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-25453257-e42a-439c-b644-163439fcbd62 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:00.113600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-25453257-e42a-439c-b644-163439fcbd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:00.136667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.142402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 801/1597] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:00 2022] PUT /identity/v3/projects/6b580789dbf641e891ada19a5ca4fc30/users/5db5b6bb121342f5bdbf255ad3da6883/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:00.143359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.145467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.202233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 797/1598] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:00.203548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283808e3-f240-48d4-bcac-0610d66fa9f3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.203835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283808e3-f240-48d4-bcac-0610d66fa9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.204108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283808e3-f240-48d4-bcac-0610d66fa9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.224999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-283808e3-f240-48d4-bcac-0610d66fa9f3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:00.228198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-283808e3-f240-48d4-bcac-0610d66fa9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:00.230971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa6bf6-43dd-4b3d-8a7a-981c3494ecea admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.234837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 798/1599] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:00.235481 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283808e3-f240-48d4-bcac-0610d66fa9f3 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.236548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.237331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.237713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.238219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.239185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.241852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.249617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283808e3-f240-48d4-bcac-0610d66fa9f3 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.254156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 802/1600] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:00.254324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.256890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.257661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.257949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.258215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] PATH_INFO: `/v3/projects/0db992826e874a8396ebf763a24f3ae7/users/b13474d8ec71457db4fa030d40ab8751/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.268014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bd69f-8858-4e16-829f-a29bd608e53b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.274155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.274356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.274621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.274920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] PATH_INFO: `/v3/projects/cd844ffb302343af8d3e33271d1dc3fd/users/1456c4aeb4b64ec5b81ab2c6df2abbb2/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.278258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db992826e874a8396ebf763a24f3ae7, user_id=b13474d8ec71457db4fa030d40ab8751, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.280673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.291688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd844ffb302343af8d3e33271d1dc3fd, user_id=1456c4aeb4b64ec5b81ab2c6df2abbb2, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.294464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.427137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 799/1601] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:00 2022] PUT /identity/v3/projects/0db992826e874a8396ebf763a24f3ae7/users/b13474d8ec71457db4fa030d40ab8751/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:00.428094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.445491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 803/1602] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:00 2022] PUT /identity/v3/projects/cd844ffb302343af8d3e33271d1dc3fd/users/1456c4aeb4b64ec5b81ab2c6df2abbb2/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:00.446144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.503075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceadc1-1193-4295-ae63-3d17e0315d34 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.522124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466677-4932-4bd0-b32b-72d99c0e9bd8 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.527151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.527842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.528137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.528416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] PATH_INFO: `/v3/projects/a5394b3ae56047e9b4a29974acf23311/users/d864862ac9474cfeb48359c18ae929c2/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.549047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5394b3ae56047e9b4a29974acf23311, user_id=d864862ac9474cfeb48359c18ae929c2, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.554062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.583332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde1874-2acc-44d6-abbf-728cd248e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.583944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde1874-2acc-44d6-abbf-728cd248e152 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.584222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde1874-2acc-44d6-abbf-728cd248e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.584490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde1874-2acc-44d6-abbf-728cd248e152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.585168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde1874-2acc-44d6-abbf-728cd248e152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.586769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde1874-2acc-44d6-abbf-728cd248e152 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.597317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 800/1603] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:00.598588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263159e4-f03a-4288-abc4-7453ef3098a9 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.598865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263159e4-f03a-4288-abc4-7453ef3098a9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.599134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263159e4-f03a-4288-abc4-7453ef3098a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.629812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-263159e4-f03a-4288-abc4-7453ef3098a9 None None] MFA Rules not processed for user `5db5b6bb121342f5bdbf255ad3da6883`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:00.631025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-263159e4-f03a-4288-abc4-7453ef3098a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:00.652077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.698943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 801/1604] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:00.699746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263159e4-f03a-4288-abc4-7453ef3098a9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.772052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263159e4-f03a-4288-abc4-7453ef3098a9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.777943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.778550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.778827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.779099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.797658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 804/1605] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:00 2022] PUT /identity/v3/projects/a5394b3ae56047e9b4a29974acf23311/users/d864862ac9474cfeb48359c18ae929c2/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:00.798695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.847324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.849290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.861030 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 802/1606] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:00.862164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.870792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214257-90d0-4de3-8eb6-bc7415156750 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.872694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e1e7-954f-448e-8dbf-61f17eed3cc4 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.874688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d526d1-2457-4182-a72e-3b71371d54bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.884275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d526d1-2457-4182-a72e-3b71371d54bc service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.884275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d526d1-2457-4182-a72e-3b71371d54bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.884275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d526d1-2457-4182-a72e-3b71371d54bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.884275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.935692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.936499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.936783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.937327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] PATH_INFO: `/v3/projects/0d357383961b4bde8ea8e4d56993ddf3/users/d9236f377c964ca6999b9d9ea3b9e630/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.949116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d526d1-2457-4182-a72e-3b71371d54bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.950524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d526d1-2457-4182-a72e-3b71371d54bc service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.954788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d357383961b4bde8ea8e4d56993ddf3, user_id=d9236f377c964ca6999b9d9ea3b9e630, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.957744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.965224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 805/1607] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:00.967392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac797b-6144-4cac-b866-481e50e648d8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.968019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac797b-6144-4cac-b866-481e50e648d8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.968356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac797b-6144-4cac-b866-481e50e648d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.994972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6dac797b-6144-4cac-b866-481e50e648d8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:00.996285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6dac797b-6144-4cac-b866-481e50e648d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:01.004524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 806/1608] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:01.006004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0878b14-2810-4cf2-b4dd-82323125dec5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.009290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0878b14-2810-4cf2-b4dd-82323125dec5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.009290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0878b14-2810-4cf2-b4dd-82323125dec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.030403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b0878b14-2810-4cf2-b4dd-82323125dec5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:01.031590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b0878b14-2810-4cf2-b4dd-82323125dec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:01.039237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 807/1609] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:01.040014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0878b14-2810-4cf2-b4dd-82323125dec5 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.054996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0878b14-2810-4cf2-b4dd-82323125dec5 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.060310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe327eeb-240b-4782-beed-66a9d569146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.060986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe327eeb-240b-4782-beed-66a9d569146b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.069221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe327eeb-240b-4782-beed-66a9d569146b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.069221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe327eeb-240b-4782-beed-66a9d569146b admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.069221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe327eeb-240b-4782-beed-66a9d569146b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.069221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe327eeb-240b-4782-beed-66a9d569146b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.074663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 808/1610] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:01.076010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de2dd-6d50-4e09-8e97-eb00dd20c3e4 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.076451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de2dd-6d50-4e09-8e97-eb00dd20c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.076699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de2dd-6d50-4e09-8e97-eb00dd20c3e4 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.078146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 809/1611] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 21:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:01.079258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd818f5-9497-421c-a2ea-3451e3c32d31 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.079620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd818f5-9497-421c-a2ea-3451e3c32d31 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.079899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd818f5-9497-421c-a2ea-3451e3c32d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.112022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 803/1612] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:00 2022] PUT /identity/v3/projects/0d357383961b4bde8ea8e4d56993ddf3/users/d9236f377c964ca6999b9d9ea3b9e630/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:01.113052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5dd818f5-9497-421c-a2ea-3451e3c32d31 None None] MFA Rules not processed for user `d864862ac9474cfeb48359c18ae929c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:01.113487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5dd818f5-9497-421c-a2ea-3451e3c32d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:01.122164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.191371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9a47e-6c29-47ed-a497-1117f3998e52 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.195507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.196127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.196578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.196862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.198271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 810/1613] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:01.199260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd818f5-9497-421c-a2ea-3451e3c32d31 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.212226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd818f5-9497-421c-a2ea-3451e3c32d31 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.216763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89196c-6d07-4330-84eb-9bc62dcbb125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.217406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89196c-6d07-4330-84eb-9bc62dcbb125 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.217704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89196c-6d07-4330-84eb-9bc62dcbb125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.217982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89196c-6d07-4330-84eb-9bc62dcbb125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.267565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.269199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.279820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 804/1614] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:01.280670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.287054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89196c-6d07-4330-84eb-9bc62dcbb125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.287946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89196c-6d07-4330-84eb-9bc62dcbb125 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.291086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f333b9e-bb6e-4785-a7e6-d69799c3b97b service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.301544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626c8ee-18dc-4e0a-82ef-25efeaaa565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.302544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 811/1615] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:01.302941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c8ee-18dc-4e0a-82ef-25efeaaa565b admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.303524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c8ee-18dc-4e0a-82ef-25efeaaa565b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.303931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a6458-62ae-4d34-8e04-8538323a08ed None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.304286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c8ee-18dc-4e0a-82ef-25efeaaa565b admin admin] PATH_INFO: `/v3/projects/7d2d213cc34c4995ae21446a5323e30c/users/f2d41981110c4b6c81239329efb127e4/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.304425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a6458-62ae-4d34-8e04-8538323a08ed None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.305204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a6458-62ae-4d34-8e04-8538323a08ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.329462 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626c8ee-18dc-4e0a-82ef-25efeaaa565b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2d213cc34c4995ae21446a5323e30c, user_id=f2d41981110c4b6c81239329efb127e4, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.333292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626c8ee-18dc-4e0a-82ef-25efeaaa565b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.334976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ad9a6458-62ae-4d34-8e04-8538323a08ed None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:01.336402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ad9a6458-62ae-4d34-8e04-8538323a08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:01.427311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.447474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 812/1616] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:01.450018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d4cf-b852-4fde-8344-290b9e6bf70c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.450018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d4cf-b852-4fde-8344-290b9e6bf70c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.456460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d4cf-b852-4fde-8344-290b9e6bf70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.495834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 805/1617] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:01 2022] PUT /identity/v3/projects/7d2d213cc34c4995ae21446a5323e30c/users/f2d41981110c4b6c81239329efb127e4/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:01.497816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c0dc-324a-418e-a419-b7051a100453 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.498588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c0dc-324a-418e-a419-b7051a100453 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.499140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c0dc-324a-418e-a419-b7051a100453 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.501464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-08c7d4cf-b852-4fde-8344-290b9e6bf70c None None] MFA Rules not processed for user `d9236f377c964ca6999b9d9ea3b9e630`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:01.502440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 806/1618] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 21:30:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:01.502832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-08c7d4cf-b852-4fde-8344-290b9e6bf70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:01.503790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576c0dc-324a-418e-a419-b7051a100453 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.601543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576c0dc-324a-418e-a419-b7051a100453 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.609343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0381ee-42d9-4faf-ad4b-6566e09e5a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.610281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0381ee-42d9-4faf-ad4b-6566e09e5a89 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.610664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0381ee-42d9-4faf-ad4b-6566e09e5a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.611111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0381ee-42d9-4faf-ad4b-6566e09e5a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.637531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 813/1619] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:01.638759 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d4cf-b852-4fde-8344-290b9e6bf70c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.656869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.713192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0381ee-42d9-4faf-ad4b-6566e09e5a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.713951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0381ee-42d9-4faf-ad4b-6566e09e5a89 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.717596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.727223 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 807/1620] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:01.741851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159a71c-39ee-44e2-8464-716aa55a9ebd None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.742161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159a71c-39ee-44e2-8464-716aa55a9ebd None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.742422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159a71c-39ee-44e2-8464-716aa55a9ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.778827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a159a71c-39ee-44e2-8464-716aa55a9ebd None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:01.782460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a159a71c-39ee-44e2-8464-716aa55a9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:01.823346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d4cf-b852-4fde-8344-290b9e6bf70c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.848699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.851172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.852005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.853496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.906828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 808/1621] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:01.909147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835f35b-ce19-4e5f-9011-e5f783c56cbd None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.909147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835f35b-ce19-4e5f-9011-e5f783c56cbd None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.909147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835f35b-ce19-4e5f-9011-e5f783c56cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.961113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-c835f35b-ce19-4e5f-9011-e5f783c56cbd None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:01.963696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c835f35b-ce19-4e5f-9011-e5f783c56cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:01.986963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.989599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:02.001417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 814/1622] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:02.002482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:02.034880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 809/1623] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:02.046186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835f35b-ce19-4e5f-9011-e5f783c56cbd None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:02.090495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835f35b-ce19-4e5f-9011-e5f783c56cbd None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:02.106084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6123b-bea1-4bde-a457-ba39b373a953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:02.109895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6123b-bea1-4bde-a457-ba39b373a953 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:02.110326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6123b-bea1-4bde-a457-ba39b373a953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:02.110728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6123b-bea1-4bde-a457-ba39b373a953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:02.125804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe489-4c35-485f-8bc0-1e544173d802 service nova] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:02.129160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:02.135580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:02.136763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:02.137403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:02.138565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:02.154671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6123b-bea1-4bde-a457-ba39b373a953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:02.156122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6123b-bea1-4bde-a457-ba39b373a953 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:02.157513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:02.161854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:02.177527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 815/1624] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:02.180127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 810/1625] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:30:02.439516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:02.456754 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d9a5-3971-4164-9be1-ef16a53e50f8 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:02.473937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea56da4-4e16-4e50-8f64-9d38cb3db81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:02.474582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea56da4-4e16-4e50-8f64-9d38cb3db81b service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:02.474960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea56da4-4e16-4e50-8f64-9d38cb3db81b service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:02.475162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea56da4-4e16-4e50-8f64-9d38cb3db81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:02.506480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea56da4-4e16-4e50-8f64-9d38cb3db81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:02.508038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea56da4-4e16-4e50-8f64-9d38cb3db81b service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:02.529373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 816/1626] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:02.559486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ee0f-87e3-4b7c-8f79-7e8d15ca714c None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:02.562093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ee0f-87e3-4b7c-8f79-7e8d15ca714c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:02.562093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ee0f-87e3-4b7c-8f79-7e8d15ca714c None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:02.564319 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 811/1627] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 21:30:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:02.574095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765572e4-2786-44c5-bfc5-7a0d89b28fa7 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:02.574434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765572e4-2786-44c5-bfc5-7a0d89b28fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:02.574645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765572e4-2786-44c5-bfc5-7a0d89b28fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:02.611707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-765572e4-2786-44c5-bfc5-7a0d89b28fa7 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:02.613100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-765572e4-2786-44c5-bfc5-7a0d89b28fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:02.625217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 817/1628] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:03.331911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ee0f-87e3-4b7c-8f79-7e8d15ca714c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:03.860376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ee0f-87e3-4b7c-8f79-7e8d15ca714c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:03.860376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5f4f8-6bf9-41f2-b9a1-6aa0cae49715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:03.860376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f4f8-6bf9-41f2-b9a1-6aa0cae49715 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:03.860376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f4f8-6bf9-41f2-b9a1-6aa0cae49715 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:03.872611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f4f8-6bf9-41f2-b9a1-6aa0cae49715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:03.872611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5f4f8-6bf9-41f2-b9a1-6aa0cae49715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:03.872611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5f4f8-6bf9-41f2-b9a1-6aa0cae49715 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:03.872611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 812/1629] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:04.271884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765572e4-2786-44c5-bfc5-7a0d89b28fa7 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:04.291134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765572e4-2786-44c5-bfc5-7a0d89b28fa7 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:04.302207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:04.302887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:04.303166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:04.303481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] PATH_INFO: `/v3/users/5db5b6bb121342f5bdbf255ad3da6883` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:04.305377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db5b6bb121342f5bdbf255ad3da6883)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:04.306451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: WARNING py.warnings [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:30:04.306451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: warnings.warn(msg) Aug 29 21:30:04.306451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: Aug 29 21:30:04.308537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:04.911808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db5b6bb121342f5bdbf255ad3da6883'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:04.948848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db5b6bb121342f5bdbf255ad3da6883'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:04.950166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db5b6bb121342f5bdbf255ad3da6883'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:04.967813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db5b6bb121342f5bdbf255ad3da6883'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:05.091272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db5b6bb121342f5bdbf255ad3da6883'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:05.124226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 818/1630] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:04 2022] DELETE /identity/v3/users/5db5b6bb121342f5bdbf255ad3da6883 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:05.125754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:05.125754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:05.125754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:05.165745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:05.170963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:05.417411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 813/1631] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:05.461249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:05.464668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:05.580289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:05.751695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165498c-3bf3-4977-bfd6-7966dfef09b5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:05.756738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789726a-a7ab-470c-9f0e-578e622545df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:05.757485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789726a-a7ab-470c-9f0e-578e622545df service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:05.757770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789726a-a7ab-470c-9f0e-578e622545df service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:05.758048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789726a-a7ab-470c-9f0e-578e622545df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:05.769856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789726a-a7ab-470c-9f0e-578e622545df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:05.771511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789726a-a7ab-470c-9f0e-578e622545df service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:05.783974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 819/1632] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:06.913525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:06.917526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:06.963627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7530b6b-1097-4db3-b4f6-91430d69b503 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:06.972674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:06.973479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:06.974235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:06.974706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] PATH_INFO: `/v3/projects/6b580789dbf641e891ada19a5ca4fc30` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:06.976741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b580789dbf641e891ada19a5ca4fc30)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:06.978124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: WARNING py.warnings [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:30:06.978124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: warnings.warn(msg) Aug 29 21:30:06.978124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: Aug 29 21:30:06.980965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:07.184763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:07.243727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b580789dbf641e891ada19a5ca4fc30', 'request_id': 'req-74fee437-b20b-4f61-8001-2aef3c0aee65'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:07.267589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b580789dbf641e891ada19a5ca4fc30', 'request_id': 'req-74fee437-b20b-4f61-8001-2aef3c0aee65'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:07.309802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b580789dbf641e891ada19a5ca4fc30', 'request_id': 'req-74fee437-b20b-4f61-8001-2aef3c0aee65'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:07.470188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] The token cache is being invalidate because project 6b580789dbf641e891ada19a5ca4fc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:07.470576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:07.471812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-74fee437-b20b-4f61-8001-2aef3c0aee65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:07.475101 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 814/1633] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:06 2022] DELETE /identity/v3/projects/6b580789dbf641e891ada19a5ca4fc30 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:07.482137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b0bf-111a-43fb-afc0-ee938a72011f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:07.483129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b0bf-111a-43fb-afc0-ee938a72011f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:07.483545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b0bf-111a-43fb-afc0-ee938a72011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:07.507922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-59a3b0bf-111a-43fb-afc0-ee938a72011f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:07.531220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-59a3b0bf-111a-43fb-afc0-ee938a72011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:07.593113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 820/1634] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:07.602393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c88-5460-465c-b46a-c2066b302ddd None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:07.602879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c88-5460-465c-b46a-c2066b302ddd None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:07.603365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c88-5460-465c-b46a-c2066b302ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:07.645226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-21015c88-5460-465c-b46a-c2066b302ddd None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:07.646787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-21015c88-5460-465c-b46a-c2066b302ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:07.666340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 815/1635] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:07.687729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b0bf-111a-43fb-afc0-ee938a72011f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:07.751604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b0bf-111a-43fb-afc0-ee938a72011f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:07.765257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:07.770634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:07.770634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:07.770634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:07.773559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:07.786784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:07.794080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:07.867436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015c88-5460-465c-b46a-c2066b302ddd None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:07.867668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 821/1636] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:07.901737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015c88-5460-465c-b46a-c2066b302ddd None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:07.925822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:07.938333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:07.938478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:07.938759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:07.940508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:07.952903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:08.234673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:08.237416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:08.277026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964e4a-2c29-441e-b348-d64b79640abc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:08.282565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 816/1637] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:07 2022] POST /identity/v3/projects => generated 403 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:08.285920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:08.302310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:08.308843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:08.308843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:08.308843 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] PATH_INFO: `/v3/users/5ed2e8fb67c5408ebfaa419c04284d94` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:08.314339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed2e8fb67c5408ebfaa419c04284d94)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:08.317199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:08.439950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872de6d1-5341-4788-8e89-3ff46094ceff admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:08.452239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:08.452239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:08.452239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:08.452239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:08.452812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:08.470016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:08.637652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 817/1638] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:08 2022] POST /identity/v3/users => generated 302 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:08.638833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:08.696537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed2e8fb67c5408ebfaa419c04284d94'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:08.704413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dffb01-b203-4565-b970-34a6f30ab0b5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:08.758078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:08.762900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:08.765594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:08.766391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed2e8fb67c5408ebfaa419c04284d94'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:08.767183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:08.769707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed2e8fb67c5408ebfaa419c04284d94'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:08.777510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:08.779472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:08.809222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed2e8fb67c5408ebfaa419c04284d94'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:08.831919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 818/1639] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:08.834017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:08.837380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:08.876747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcad15e-19fa-4fe4-806b-dbc886d9a974 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:08.919903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:08.920715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:08.921130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:08.921507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:08.922338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:08.924059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:08.956340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 819/1640] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:08.963732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:08.977825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e4193-46e4-4751-8a17-d9696f555814 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:08.999054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9d9d-5f75-4ca1-a203-19647fb7cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:09.000338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9d9d-5f75-4ca1-a203-19647fb7cfda admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:09.001490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9d9d-5f75-4ca1-a203-19647fb7cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:09.001926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9d9d-5f75-4ca1-a203-19647fb7cfda admin admin] PATH_INFO: `/v3/projects/1ed2ead386154910a439dd1db99fd27a/users/626d0629e8114569bb88e93c46dfabe3/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:09.022450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ffac1975-1272-484e-a78a-50bf51c34b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed2e8fb67c5408ebfaa419c04284d94'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:09.031953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f9d9d-5f75-4ca1-a203-19647fb7cfda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed2ead386154910a439dd1db99fd27a, user_id=626d0629e8114569bb88e93c46dfabe3, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:09.035604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f9d9d-5f75-4ca1-a203-19647fb7cfda admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:09.040836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 822/1641] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:08 2022] DELETE /identity/v3/users/5ed2e8fb67c5408ebfaa419c04284d94 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:09.049517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:09.050006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:09.050425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:09.082821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:09.084418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:09.132692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:09.216940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 820/1642] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:08 2022] PUT /identity/v3/projects/1ed2ead386154910a439dd1db99fd27a/users/626d0629e8114569bb88e93c46dfabe3/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:30:09.219797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e6aea-716c-4396-955f-e1df4e131230 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:09.219938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e6aea-716c-4396-955f-e1df4e131230 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:09.220237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e6aea-716c-4396-955f-e1df4e131230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:09.266860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e36e6aea-716c-4396-955f-e1df4e131230 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:09.266860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e36e6aea-716c-4396-955f-e1df4e131230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:09.267084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 823/1643] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:09.313594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:09.315501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:09.439058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 821/1644] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:09.512633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c184c-c5b6-4630-b6f6-7a23b5c85860 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:09.529437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e6aea-716c-4396-955f-e1df4e131230 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:09.609549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:09.616208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:09.617055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:09.617572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:09.630121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:09.632122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:09.672276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 824/1645] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:09.707252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e6aea-716c-4396-955f-e1df4e131230 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:09.714407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:09.716128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:09.716716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:09.717255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:09.731644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:09.733416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:09.746469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 822/1646] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:09.850285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:13.071465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:13.078235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:13.099169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043047-2762-43fa-ba3d-379af626f837 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:13.114917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:13.115574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:13.115883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:13.116334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] PATH_INFO: `/v3/projects/b0c2ee3f7f854fd8b4c193c63c1a203a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:13.117684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c2ee3f7f854fd8b4c193c63c1a203a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:13.120368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:13.391575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c2ee3f7f854fd8b4c193c63c1a203a', 'request_id': 'req-dbab798e-e354-4805-95af-23a17d642e30'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.425790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:13.427190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:13.454831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac822-0a84-45b7-a50d-c7526df78d34 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:13.466301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c2ee3f7f854fd8b4c193c63c1a203a', 'request_id': 'req-dbab798e-e354-4805-95af-23a17d642e30'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.475017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c2ee3f7f854fd8b4c193c63c1a203a', 'request_id': 'req-dbab798e-e354-4805-95af-23a17d642e30'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.495648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:13.505667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] The token cache is being invalidate because project b0c2ee3f7f854fd8b4c193c63c1a203a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:13.506340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.507744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-dbab798e-e354-4805-95af-23a17d642e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.518613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 825/1647] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:13 2022] DELETE /identity/v3/projects/b0c2ee3f7f854fd8b4c193c63c1a203a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:13.523268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f9e7-8b70-42ca-afec-a9299f793656 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:13.523867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f9e7-8b70-42ca-afec-a9299f793656 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:13.524344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f9e7-8b70-42ca-afec-a9299f793656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:13.574808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f2f1f9e7-8b70-42ca-afec-a9299f793656 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:13.574808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f2f1f9e7-8b70-42ca-afec-a9299f793656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:13.603480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:13.604164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:13.604623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:13.605101 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] PATH_INFO: `/v3/users/d9236f377c964ca6999b9d9ea3b9e630` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:13.607320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9236f377c964ca6999b9d9ea3b9e630)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:13.610285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:13.737794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 826/1648] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:13.746796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26878-3d06-4f5b-b796-aed5938a7c86 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:13.749187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26878-3d06-4f5b-b796-aed5938a7c86 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:13.749187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26878-3d06-4f5b-b796-aed5938a7c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:13.813797 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a1e26878-3d06-4f5b-b796-aed5938a7c86 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:13.817652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a1e26878-3d06-4f5b-b796-aed5938a7c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:13.858462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 827/1649] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:13.862989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26878-3d06-4f5b-b796-aed5938a7c86 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:13.895422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26878-3d06-4f5b-b796-aed5938a7c86 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:13.909145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:13.909353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9236f377c964ca6999b9d9ea3b9e630'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.910037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:13.913590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:13.915510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:13.915510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:13.927491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:13.929453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:13.961939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9236f377c964ca6999b9d9ea3b9e630'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.974494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 828/1650] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:13.976515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:13.984394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9236f377c964ca6999b9d9ea3b9e630'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:13.990604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:14.007473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0310-825f-4c30-92b1-b79e35ecec6c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:14.043599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:14.044291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.044586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.044861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.045630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:14.047915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:14.119762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9236f377c964ca6999b9d9ea3b9e630'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:14.120812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-167dba1d-00da-4939-b9bc-828937dcf74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9236f377c964ca6999b9d9ea3b9e630'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:14.129472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 823/1651] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:13 2022] DELETE /identity/v3/users/d9236f377c964ca6999b9d9ea3b9e630 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:14.136036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.136376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.136666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.197762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:14.207013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:14.261232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 829/1652] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:13 2022] POST /identity/v3/projects => generated 363 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:14.262308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:14.265714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:14.428491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 824/1653] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:14.449873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:14.456465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:14.560394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792482-166c-4a70-8d58-de8f2a3e7396 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:14.589619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:14.589969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.590832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.591412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.596748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:14.611853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:14.687252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0bff-7ef0-43d4-9a6a-7e82ea63983f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:14.853765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:14.854412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.854690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.854958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.883683 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:14.890339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:14.920262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 825/1654] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:30:15.004089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 830/1655] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:14 2022] POST /identity/v3/users => generated 282 bytes in 739 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:15.004990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:15.022126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43582cab-4931-4e55-88cf-16f2e13ff1a0 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:15.038301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:15.038929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:15.039442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:15.039735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:15.040376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:15.043545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:15.123402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 826/1656] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:15.123567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:15.132785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45cfc3-4366-4474-af7f-25bf6ecede79 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:15.147199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712d36-a430-458b-b703-3dd86b2dd5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:15.148299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712d36-a430-458b-b703-3dd86b2dd5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:15.148930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712d36-a430-458b-b703-3dd86b2dd5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:15.149345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712d36-a430-458b-b703-3dd86b2dd5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:15.151274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9712d36-a430-458b-b703-3dd86b2dd5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:15.155356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9712d36-a430-458b-b703-3dd86b2dd5b7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:15.180817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 831/1657] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:30:15.187370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:15.204727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40869fa8-26d4-46ed-8b60-5d940edbf97c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:15.217585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:15.218364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:15.219123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:15.220402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] PATH_INFO: `/v3/projects/188778089e11494ba4cdd4449c0d8885/users/14ed00e7ffee49cda3eadd26ca9cc2e6/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:15.260955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188778089e11494ba4cdd4449c0d8885, user_id=14ed00e7ffee49cda3eadd26ca9cc2e6, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:15.265587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:15.409314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 827/1658] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:15 2022] PUT /identity/v3/projects/188778089e11494ba4cdd4449c0d8885/users/14ed00e7ffee49cda3eadd26ca9cc2e6/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:15.413314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90e08b-ddd6-4ba9-a4d6-299fd66edf94 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:15.414200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90e08b-ddd6-4ba9-a4d6-299fd66edf94 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:15.414631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90e08b-ddd6-4ba9-a4d6-299fd66edf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:15.511615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1d90e08b-ddd6-4ba9-a4d6-299fd66edf94 None None] MFA Rules not processed for user `14ed00e7ffee49cda3eadd26ca9cc2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:15.511615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1d90e08b-ddd6-4ba9-a4d6-299fd66edf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:15.739727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 832/1659] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:15.747082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:15.770624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad73b-d660-4bce-a4c2-9f1af91ada5d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:15.771339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad73b-d660-4bce-a4c2-9f1af91ada5d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:15.771817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad73b-d660-4bce-a4c2-9f1af91ada5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:15.882885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-3b7ad73b-d660-4bce-a4c2-9f1af91ada5d None None] MFA Rules not processed for user `1456c4aeb4b64ec5b81ab2c6df2abbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:15.884296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3b7ad73b-d660-4bce-a4c2-9f1af91ada5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:15.907879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:15.920951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f503191-b18d-4906-b404-91ea7307f244 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:15.929204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:15.932990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:15.932990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:15.932990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:15.932990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:15.934421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:16.092180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 833/1660] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:16.094059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06daa-68f9-46d8-ac21-b879a8fc3664 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:16.094425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06daa-68f9-46d8-ac21-b879a8fc3664 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:16.095011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06daa-68f9-46d8-ac21-b879a8fc3664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:16.169926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 828/1661] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:15 2022] POST /identity/v3/projects => generated 363 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:16.171355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:16.176413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:16.220023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-75e06daa-68f9-46d8-ac21-b879a8fc3664 None None] MFA Rules not processed for user `626d0629e8114569bb88e93c46dfabe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:16.225295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-75e06daa-68f9-46d8-ac21-b879a8fc3664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:16.337255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:16.505618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 834/1662] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:16.507241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e06daa-68f9-46d8-ac21-b879a8fc3664 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:16.520464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4902-c039-4f05-8762-1fb3316c20f8 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:16.555896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:16.560735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:16.561041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:16.562958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:16.727332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e06daa-68f9-46d8-ac21-b879a8fc3664 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:16.735553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:16.738019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:16.738019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:16.738019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:16.738019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:16.741341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:16.820768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:16.823612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:16.895985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 829/1663] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:16.903426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:16.925302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 835/1664] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:16 2022] POST /identity/v3/users => generated 288 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:16.926424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:16.933705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:16.978056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a1d9-20e7-4e2f-bc13-8231d863dcb9 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:16.989147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29819bec-26c6-4ad6-b4e9-213f18a2f735 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:17.001989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.002730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.004463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.004751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.004901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.005036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.005517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.006622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.006907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.009264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.012194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:17.016273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:17.061634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 836/1665] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:17.063736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:17.095154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa755d-5919-401d-91ae-5c1adf705128 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:17.135411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.136273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.136709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.137165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] PATH_INFO: `/v3/projects/c53ef804af194827852803bee643ccbe/users/da9226914b3d44a8bfcde93e1acc505e/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.153338 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 830/1666] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:16 2022] POST /identity/v3/projects => generated 405 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:17.155450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:17.190344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53ef804af194827852803bee643ccbe, user_id=da9226914b3d44a8bfcde93e1acc505e, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.195385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:17.318673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 837/1667] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:17 2022] PUT /identity/v3/projects/c53ef804af194827852803bee643ccbe/users/da9226914b3d44a8bfcde93e1acc505e/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:17.319987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:17.355623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ad0da-2389-4d19-98f7-56ed17430ff0 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:17.481044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.485313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.485703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.486061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.486834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.491943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:17.533053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd4322-bce7-41b4-88f2-4288531e7a0b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:17.643350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.643350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.643350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.643350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.645150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.645150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:17.645150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 838/1668] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:17.645150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:17.645150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb764-bc48-47d3-a411-4ebb0821d7b4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:17.646304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b6726-8ab9-44f3-9453-e8171f884201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.646304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6726-8ab9-44f3-9453-e8171f884201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.649121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6726-8ab9-44f3-9453-e8171f884201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.650633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6726-8ab9-44f3-9453-e8171f884201 admin admin] PATH_INFO: `/v3/projects/c53ef804af194827852803bee643ccbe/users/da9226914b3d44a8bfcde93e1acc505e/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.658876 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b6726-8ab9-44f3-9453-e8171f884201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53ef804af194827852803bee643ccbe, user_id=da9226914b3d44a8bfcde93e1acc505e, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.667597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b6726-8ab9-44f3-9453-e8171f884201 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:17.713668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 839/1669] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:17 2022] PUT /identity/v3/projects/c53ef804af194827852803bee643ccbe/users/da9226914b3d44a8bfcde93e1acc505e/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:17.715975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.716348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.716700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.793590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] MFA Rules not processed for user `da9226914b3d44a8bfcde93e1acc505e`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:17.795065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:17.811791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 831/1670] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:17 2022] POST /identity/v3/users => generated 309 bytes in 654 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:17.813522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:17.840526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc5b09-1876-4ae2-a49c-123b512b3737 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:18.047371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:18.048096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:18.048377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:18.048656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:18.049529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:18.051613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:18.056695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 840/1671] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:18.058051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:18.068128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:18.098167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8dc3-e660-4794-bfa3-6de15fa92ce3 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:18.106669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 832/1672] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:30:18.109384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:18.112440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:18.114144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:18.114772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:18.115067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:18.115294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] PATH_INFO: `/v3/projects/0d357383961b4bde8ea8e4d56993ddf3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:18.116460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d357383961b4bde8ea8e4d56993ddf3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:18.118483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:18.207926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7709-d528-4de8-b935-319495646205 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:18.212526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:18.213584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:18.213896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:18.214147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:18.225900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:18.227950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:18.242638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 833/1673] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:18.249472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:18.255001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433dba-9f85-4c6f-86e5-27f32a67f78c service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:18.260621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:18.261773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:18.262255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:18.262705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] PATH_INFO: `/v3/projects/401f40d96d0944b699c5191292774193/users/841c9ed0e5534a04989c3c6cc6c5a360/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:18.285246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=401f40d96d0944b699c5191292774193, user_id=841c9ed0e5534a04989c3c6cc6c5a360, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:18.287951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:18.342177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d357383961b4bde8ea8e4d56993ddf3', 'request_id': 'req-df2ca56c-1c2c-4368-adb0-96ecfb08a960'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:18.409950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:18.480505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d357383961b4bde8ea8e4d56993ddf3', 'request_id': 'req-df2ca56c-1c2c-4368-adb0-96ecfb08a960'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:18.504224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d357383961b4bde8ea8e4d56993ddf3', 'request_id': 'req-df2ca56c-1c2c-4368-adb0-96ecfb08a960'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:18.505513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 834/1674] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:18 2022] PUT /identity/v3/projects/401f40d96d0944b699c5191292774193/users/841c9ed0e5534a04989c3c6cc6c5a360/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:18.509932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:18.538724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] The token cache is being invalidate because project 0d357383961b4bde8ea8e4d56993ddf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:18.541871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:18.543963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-df2ca56c-1c2c-4368-adb0-96ecfb08a960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:18.547364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 841/1675] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:18 2022] DELETE /identity/v3/projects/0d357383961b4bde8ea8e4d56993ddf3 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:18.553047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:18.553430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:18.553730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:18.631899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:18.637993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:18.735114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc253a-07ff-4c84-919e-3212fbdbd5cc admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:18.755655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:18.756804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:18.757489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:18.758327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:18.760983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:18.765689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:18.816867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 835/1676] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:18.821806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:18.832716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:18.878732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 842/1677] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:18.880043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:18.885482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:18.933240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c019b0-4964-459d-bb9e-4d0440bc0eec None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:18.949674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b09c6-2eb0-499c-92ef-938a2ab5e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:18.952697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b09c6-2eb0-499c-92ef-938a2ab5e030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:18.953565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b09c6-2eb0-499c-92ef-938a2ab5e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:18.954365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b09c6-2eb0-499c-92ef-938a2ab5e030 admin admin] PATH_INFO: `/v3/projects/401f40d96d0944b699c5191292774193/users/841c9ed0e5534a04989c3c6cc6c5a360/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:18.957853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b09c6-2eb0-499c-92ef-938a2ab5e030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401f40d96d0944b699c5191292774193, user_id=841c9ed0e5534a04989c3c6cc6c5a360, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:18.961587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b09c6-2eb0-499c-92ef-938a2ab5e030 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:19.002965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 843/1678] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:18 2022] PUT /identity/v3/projects/401f40d96d0944b699c5191292774193/users/841c9ed0e5534a04989c3c6cc6c5a360/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:19.005233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c644001-0e6e-4992-98ac-84b4b5ff9d59 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:19.005726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:19.006029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:19.006660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:19.064256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:19.067048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:19.122088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:19.185984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:19.187322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:19.187775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:19.188219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:19.198020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:19.299255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:19.327420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 844/1679] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:19.327420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:19.330379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:19.436452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9e37-e4ad-4e06-9741-db2ffce91232 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:19.464560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:19.466070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:19.466070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:19.466070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] PATH_INFO: `/v3/users/d864862ac9474cfeb48359c18ae929c2` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:19.480036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d864862ac9474cfeb48359c18ae929c2)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:19.487244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:19.549202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:19.549919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:19.605637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 836/1680] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:19.608489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:19.641773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c287c-c964-42a8-ac15-c88070d43c61 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:19.665565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:19.666458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:19.666844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:19.667579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:19.673363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:19.673363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:19.678842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:19.747358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 837/1681] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:19.756171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:19.805846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735fe54-4f3d-423b-a1c6-fe9ff647cae6 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:19.825906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:19.826541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:19.827128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:19.827575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:19.828492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:19.841864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:19.902850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd864862ac9474cfeb48359c18ae929c2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:19.947810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd864862ac9474cfeb48359c18ae929c2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:19.950856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd864862ac9474cfeb48359c18ae929c2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:19.972672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd864862ac9474cfeb48359c18ae929c2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:20.006312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 838/1682] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:19 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:30:20.017322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:20.019256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:20.067127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f5925e17-c12d-4926-9fb1-388e0abd2fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd864862ac9474cfeb48359c18ae929c2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:20.080213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 845/1683] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:19 2022] DELETE /identity/v3/users/d864862ac9474cfeb48359c18ae929c2 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:20.087859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592c37-4250-4441-9f3f-b79f327f7c35 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.089877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592c37-4250-4441-9f3f-b79f327f7c35 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.090377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592c37-4250-4441-9f3f-b79f327f7c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.150004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c5592c37-4250-4441-9f3f-b79f327f7c35 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:20.155161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c5592c37-4250-4441-9f3f-b79f327f7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:20.172550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e411e6b-33f7-402b-9b42-a1d3144705c0 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:20.290540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:20.293187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.293187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.293187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.293187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:20.295241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:20.360001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 846/1684] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:20.365908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.369383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.372825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.459290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] MFA Rules not processed for user `b13474d8ec71457db4fa030d40ab8751`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:20.460652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:20.486500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 839/1685] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:20 2022] POST /identity/v3/users => generated 288 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:20.487707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:20.511616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:20.582310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f993c6e-1fdc-4225-8c3e-c562bd262db2 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:20.621916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:20.625594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.625594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.625594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.667025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:20.674980 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:20.746190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 840/1686] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:20.749997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:20.755421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 847/1687] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:20.773363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15aeb7-f500-4f83-b5c1-39bd5a27680e service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:20.782414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:20.784126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:20.803040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:20.804250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.804775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.806013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.806877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:20.814504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:20.880390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 841/1688] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:20.882956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:20.928953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a761e-59e5-4ad8-99fe-5737643afc53 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:20.949893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:20.950633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.950914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.951190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.952064 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:20.958350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:20.983015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 842/1689] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:20.999357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:21.032769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:21.042606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadda9d-b7ed-4962-912f-ca3509476bdf admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:21.078043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1ce75-0240-472c-bf68-c2b0e8edd557 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:21.079250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:21.081530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:21.083744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:21.086686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] PATH_INFO: `/v3/projects/f847adfd7f0f46f0a7b2ab17dd8850f5/users/8c19eea793574881ab687840b99dc86c/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:21.108928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a92dac-73c8-4a25-8660-7e6d07a0dcc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:21.112341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92dac-73c8-4a25-8660-7e6d07a0dcc1 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:21.113400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92dac-73c8-4a25-8660-7e6d07a0dcc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:21.116862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92dac-73c8-4a25-8660-7e6d07a0dcc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:21.142340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f847adfd7f0f46f0a7b2ab17dd8850f5, user_id=8c19eea793574881ab687840b99dc86c, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:21.145542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:21.147153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a92dac-73c8-4a25-8660-7e6d07a0dcc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:21.148996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a92dac-73c8-4a25-8660-7e6d07a0dcc1 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:21.178793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 848/1690] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:21.248910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 843/1691] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:20 2022] PUT /identity/v3/projects/f847adfd7f0f46f0a7b2ab17dd8850f5/users/8c19eea793574881ab687840b99dc86c/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:21.262120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd177-c7c8-4db9-9dac-d616c66523b0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:21.262572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd177-c7c8-4db9-9dac-d616c66523b0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:21.262768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd177-c7c8-4db9-9dac-d616c66523b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:21.347141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e21dd177-c7c8-4db9-9dac-d616c66523b0 None None] MFA Rules not processed for user `8c19eea793574881ab687840b99dc86c`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:21.348386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e21dd177-c7c8-4db9-9dac-d616c66523b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:21.363344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:21.527588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 849/1692] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:21.532375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:21.696735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32cdb7-8a39-48b4-9c43-504737774dca admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:21.709903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:21.710736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:21.711087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:21.711703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:21.712437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:21.716789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:21.845854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 844/1693] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:21 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:21.851163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd177-c7c8-4db9-9dac-d616c66523b0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:21.885828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd177-c7c8-4db9-9dac-d616c66523b0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:22.056224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:22.059197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:22.059687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:22.060107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:22.060939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:22.085371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:22.228059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 850/1694] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:21 2022] POST /identity/v3/users => generated 294 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:22.235535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:22.257774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c11090-fa2a-422b-9edb-883adf571d2a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:22.281880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df789196-bd5e-4250-8c8f-22133b78cc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:22.282754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df789196-bd5e-4250-8c8f-22133b78cc7f admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:22.284999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df789196-bd5e-4250-8c8f-22133b78cc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:22.285567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df789196-bd5e-4250-8c8f-22133b78cc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:22.286251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df789196-bd5e-4250-8c8f-22133b78cc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:22.289973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df789196-bd5e-4250-8c8f-22133b78cc7f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:22.324362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 845/1695] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:22.326153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:22.351666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227611a-0d43-48ff-81be-efea6bf66b8b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:22.357109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76991d40-f7d7-46b0-9fbb-feefe2ffe319 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:22.357109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76991d40-f7d7-46b0-9fbb-feefe2ffe319 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:22.357398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76991d40-f7d7-46b0-9fbb-feefe2ffe319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:22.366483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:22.367375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:22.367598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:22.369303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] PATH_INFO: `/v3/projects/c911d8755491460893064a3cfe06ae0d/users/5df23f5bf7b84f8d901bc61673090665/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:22.439667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c911d8755491460893064a3cfe06ae0d, user_id=5df23f5bf7b84f8d901bc61673090665, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:22.439999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:22.443840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-76991d40-f7d7-46b0-9fbb-feefe2ffe319 None None] MFA Rules not processed for user `d5778532fdeb49aa80bebc165208165b`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:22.445422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-76991d40-f7d7-46b0-9fbb-feefe2ffe319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:22.593574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 851/1696] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:22 2022] PUT /identity/v3/projects/c911d8755491460893064a3cfe06ae0d/users/5df23f5bf7b84f8d901bc61673090665/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:22.593574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:22.598368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:22.697887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 846/1697] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:22.704236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76991d40-f7d7-46b0-9fbb-feefe2ffe319 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:22.791807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76991d40-f7d7-46b0-9fbb-feefe2ffe319 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:22.936728 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb19f2-24b5-4b81-ae7f-370b81305dc2 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:22.957245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:22.959559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec90d48-bc83-4209-9be8-06748abb51eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:22.960471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec90d48-bc83-4209-9be8-06748abb51eb admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:22.960983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec90d48-bc83-4209-9be8-06748abb51eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:22.961529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec90d48-bc83-4209-9be8-06748abb51eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:22.962776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:22.963467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:22.964501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] PATH_INFO: `/v3/projects/a5394b3ae56047e9b4a29974acf23311` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:22.965544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec90d48-bc83-4209-9be8-06748abb51eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:22.965669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5394b3ae56047e9b4a29974acf23311)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:22.967729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:22.968053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec90d48-bc83-4209-9be8-06748abb51eb admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:22.985844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 847/1698] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:22.987722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d699b-b449-4f37-aaff-d6725615cca0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:22.988315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d699b-b449-4f37-aaff-d6725615cca0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:22.988789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d699b-b449-4f37-aaff-d6725615cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.031951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-627d699b-b449-4f37-aaff-d6725615cca0 None None] MFA Rules not processed for user `d5778532fdeb49aa80bebc165208165b`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:23.034317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-627d699b-b449-4f37-aaff-d6725615cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:23.119544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:23.178929 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5394b3ae56047e9b4a29974acf23311', 'request_id': 'req-d9082a40-dc04-4754-83a1-5911a2fc7154'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:23.212155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 848/1699] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:23.217829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d699b-b449-4f37-aaff-d6725615cca0 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:23.254170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d699b-b449-4f37-aaff-d6725615cca0 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:23.358962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5394b3ae56047e9b4a29974acf23311', 'request_id': 'req-d9082a40-dc04-4754-83a1-5911a2fc7154'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:23.370505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5394b3ae56047e9b4a29974acf23311', 'request_id': 'req-d9082a40-dc04-4754-83a1-5911a2fc7154'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:23.395301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] The token cache is being invalidate because project a5394b3ae56047e9b4a29974acf23311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:23.395690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:23.402855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a718f-c9f6-4981-9a83-99cb942cbc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:23.403707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:23.403838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a718f-c9f6-4981-9a83-99cb942cbc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.403995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a718f-c9f6-4981-9a83-99cb942cbc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.404278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a718f-c9f6-4981-9a83-99cb942cbc9e admin admin] PATH_INFO: `/v3/projects/c911d8755491460893064a3cfe06ae0d/users/5df23f5bf7b84f8d901bc61673090665/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.419153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 852/1700] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:22 2022] DELETE /identity/v3/projects/a5394b3ae56047e9b4a29974acf23311 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:23.419153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:23.422105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a718f-c9f6-4981-9a83-99cb942cbc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c911d8755491460893064a3cfe06ae0d, user_id=5df23f5bf7b84f8d901bc61673090665, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:23.424665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:23.432279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a718f-c9f6-4981-9a83-99cb942cbc9e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:23.479880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 849/1701] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:23 2022] PUT /identity/v3/projects/c911d8755491460893064a3cfe06ae0d/users/5df23f5bf7b84f8d901bc61673090665/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:23.479880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4764a-e20b-4d35-9042-bf44f17d03de None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.479880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4764a-e20b-4d35-9042-bf44f17d03de None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.479880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4764a-e20b-4d35-9042-bf44f17d03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.537109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-cbb4764a-e20b-4d35-9042-bf44f17d03de None None] MFA Rules not processed for user `f2d41981110c4b6c81239329efb127e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:23.540032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-cbb4764a-e20b-4d35-9042-bf44f17d03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:23.631256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9082a40-dc04-4754-83a1-5911a2fc7154 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:23.669744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 850/1702] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:23.690032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d1bd-9b44-4479-953e-919645538b2c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.690385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d1bd-9b44-4479-953e-919645538b2c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.691219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d1bd-9b44-4479-953e-919645538b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.725850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ed91d1bd-9b44-4479-953e-919645538b2c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:23.727900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ed91d1bd-9b44-4479-953e-919645538b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:23.739073 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83a461-369c-42e4-ae63-865aa36844a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:23.739928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a461-369c-42e4-ae63-865aa36844a6 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.740212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a461-369c-42e4-ae63-865aa36844a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.740915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a461-369c-42e4-ae63-865aa36844a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.750239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-aa83a461-369c-42e4-ae63-865aa36844a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:23.859257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 851/1703] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:23.869939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4b4e-1909-4a44-a25d-19278eb35d2b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.870546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4b4e-1909-4a44-a25d-19278eb35d2b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.870994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4b4e-1909-4a44-a25d-19278eb35d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.874693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83a461-369c-42e4-ae63-865aa36844a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:23.877381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83a461-369c-42e4-ae63-865aa36844a6 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:23.893523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 853/1704] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:23.895242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fa4d-8c11-4355-88f5-d0acc9930a51 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.895646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fa4d-8c11-4355-88f5-d0acc9930a51 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.895933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fa4d-8c11-4355-88f5-d0acc9930a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.928452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-bd4c4b4e-1909-4a44-a25d-19278eb35d2b None None] MFA Rules not processed for user `5df23f5bf7b84f8d901bc61673090665`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:23.930023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bd4c4b4e-1909-4a44-a25d-19278eb35d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:23.935113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e554fa4d-8c11-4355-88f5-d0acc9930a51 None None] MFA Rules not processed for user `841c9ed0e5534a04989c3c6cc6c5a360`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:23.937180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e554fa4d-8c11-4355-88f5-d0acc9930a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:24.085974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 852/1705] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:24.089490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.089813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.090056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.121548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 854/1706] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:24.122798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.124948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.124948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.139531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] MFA Rules not processed for user `f2d41981110c4b6c81239329efb127e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:24.140777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:24.165316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 853/1707] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:24.166326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.171938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:24.173277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:24.175656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:24.193588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 855/1708] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:24.194941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.197522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:24.221510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3a1e5-f4d0-4454-beb9-e2975359a537 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.229429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.230242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.230629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.231291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.244197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.247720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.264071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 856/1709] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:24.265402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.280709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6546-f01e-4776-b95f-28353b25b643 service nova] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.287489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.288354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.288886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.289301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.290082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:24.290529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.292850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.300391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:24.321046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 857/1710] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:24.329562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.365476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfd6bc-3321-4113-95aa-d35925d6a1db admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.379473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.380835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.381249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.381647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.382519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.391549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbfe89-1e44-4fdc-bb5e-e1fd68a6bed2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.399301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.411137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.412280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.412882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.413097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.416382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:24.543003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.547086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.560642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 854/1711] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:24.565657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.576810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 858/1712] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:24 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:24.582597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a539e-bdd2-44e8-88ca-c7400166678e service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.633401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:24.797675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.807157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.807736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.808297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.809659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.813999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:25.005729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 855/1713] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:24 2022] POST /identity/v3/users => generated 303 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:30:25.010354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:25.028805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d7815-c6db-4d04-96c6-af4c8a3c8925 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:25.046796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474c38-cdbe-483f-b20b-2afc000809c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:25.049093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474c38-cdbe-483f-b20b-2afc000809c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.049093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474c38-cdbe-483f-b20b-2afc000809c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.049093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474c38-cdbe-483f-b20b-2afc000809c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.049093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474c38-cdbe-483f-b20b-2afc000809c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:25.052577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474c38-cdbe-483f-b20b-2afc000809c5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:25.083905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 859/1714] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:25.089124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:25.111678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f8e79-7bda-4417-a31e-e45aa046e944 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:25.147766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:25.152446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.152809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.154613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.155483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:25.157349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:25.192281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 856/1715] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:25.193364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:25.197435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954ad3d-f43d-4f9e-901c-be7a8e7d5e0d None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.197993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954ad3d-f43d-4f9e-901c-be7a8e7d5e0d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.198170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954ad3d-f43d-4f9e-901c-be7a8e7d5e0d None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.200570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 860/1716] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 21:30:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:25.201391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954ad3d-f43d-4f9e-901c-be7a8e7d5e0d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:25.203799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d954ad3d-f43d-4f9e-901c-be7a8e7d5e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:25.215515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26e2f2-4afc-4664-9e25-ae2c23d74c23 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:25.232404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0651-4f51-4b7e-81be-0e8a2adc4ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:25.233155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0651-4f51-4b7e-81be-0e8a2adc4ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.251504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954ad3d-f43d-4f9e-901c-be7a8e7d5e0d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:25.251804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0651-4f51-4b7e-81be-0e8a2adc4ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.251804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0651-4f51-4b7e-81be-0e8a2adc4ab0 admin admin] PATH_INFO: `/v3/projects/dae0af5f20e14a15b69c094fe3d60795/users/e7c216a002d94ac9829c63754a55f625/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.251977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:25.251977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.251977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.251977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] PATH_INFO: `/v3/users/14ed00e7ffee49cda3eadd26ca9cc2e6` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.252769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ed00e7ffee49cda3eadd26ca9cc2e6)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:25.267879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:25.277834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0651-4f51-4b7e-81be-0e8a2adc4ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae0af5f20e14a15b69c094fe3d60795, user_id=e7c216a002d94ac9829c63754a55f625, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:25.281739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0651-4f51-4b7e-81be-0e8a2adc4ab0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:25.691429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 857/1717] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:25 2022] PUT /identity/v3/projects/dae0af5f20e14a15b69c094fe3d60795/users/e7c216a002d94ac9829c63754a55f625/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:25.693678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4f26-bc5b-46a8-9ec0-7f525346aba0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.694010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4f26-bc5b-46a8-9ec0-7f525346aba0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.694306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4f26-bc5b-46a8-9ec0-7f525346aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.751454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-938d4f26-bc5b-46a8-9ec0-7f525346aba0 None None] MFA Rules not processed for user `e72f7d1f9961446c8938e3f161fb03f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:25.754962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-938d4f26-bc5b-46a8-9ec0-7f525346aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:25.831549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 858/1718] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:25.831549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163219-5623-41c3-b97a-100cb412ca0a None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.831549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163219-5623-41c3-b97a-100cb412ca0a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.831549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163219-5623-41c3-b97a-100cb412ca0a None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.831987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 859/1719] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 21:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:25.833022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36cc78-a3fd-4bb3-95ad-b27fea9a7fc5 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.833329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36cc78-a3fd-4bb3-95ad-b27fea9a7fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.833631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36cc78-a3fd-4bb3-95ad-b27fea9a7fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.996264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-aa36cc78-a3fd-4bb3-95ad-b27fea9a7fc5 None None] MFA Rules not processed for user `e7c216a002d94ac9829c63754a55f625`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:26.001915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-aa36cc78-a3fd-4bb3-95ad-b27fea9a7fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.022845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ed00e7ffee49cda3eadd26ca9cc2e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:26.059496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ed00e7ffee49cda3eadd26ca9cc2e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:26.063211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ed00e7ffee49cda3eadd26ca9cc2e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:26.083324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ed00e7ffee49cda3eadd26ca9cc2e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:26.258119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-42117f23-48c8-4ab7-b268-11268b3b1b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ed00e7ffee49cda3eadd26ca9cc2e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:26.278419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 861/1720] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:25 2022] DELETE /identity/v3/users/14ed00e7ffee49cda3eadd26ca9cc2e6 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:26.279960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:26.280516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:26.280934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:26.282246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 860/1721] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:26.285600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:26.286288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:26.291300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:26.322015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] MFA Rules not processed for user `e72f7d1f9961446c8938e3f161fb03f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:26.326134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.359760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] MFA Rules not processed for user `1456c4aeb4b64ec5b81ab2c6df2abbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:26.363403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.579640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 862/1722] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:26.580600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:26.592986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.609800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 861/1723] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:26.611608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:26.620232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.638553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c662-2055-446f-bd8e-99239c81e6b8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:26.649525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b522c-3e51-4c8b-8c9f-38cd964af93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:26.650067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b522c-3e51-4c8b-8c9f-38cd964af93d service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:26.650630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b522c-3e51-4c8b-8c9f-38cd964af93d service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:26.650915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b522c-3e51-4c8b-8c9f-38cd964af93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:26.654410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-833b522c-3e51-4c8b-8c9f-38cd964af93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.673421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b522c-3e51-4c8b-8c9f-38cd964af93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:26.676401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b522c-3e51-4c8b-8c9f-38cd964af93d service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:26.693830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 863/1724] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:26.697930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e22c36-990b-46ee-8e20-6235f604418b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:26.697930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e22c36-990b-46ee-8e20-6235f604418b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:26.697930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e22c36-990b-46ee-8e20-6235f604418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:26.730293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:26.744946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-19e22c36-990b-46ee-8e20-6235f604418b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:26.748853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-19e22c36-990b-46ee-8e20-6235f604418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.858263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fc816-bfae-4928-b06a-7db3b9915455 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:26.882328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c897a28-8e8a-44e1-9190-94d3ab5728e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:26.882974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897a28-8e8a-44e1-9190-94d3ab5728e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:26.883260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897a28-8e8a-44e1-9190-94d3ab5728e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:26.883533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897a28-8e8a-44e1-9190-94d3ab5728e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:26.884192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c897a28-8e8a-44e1-9190-94d3ab5728e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:26.886320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c897a28-8e8a-44e1-9190-94d3ab5728e0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:26.940182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 864/1725] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:26.941610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ac49-004c-4e8f-8f41-c65c1316adf1 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:26.941899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ac49-004c-4e8f-8f41-c65c1316adf1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:26.942173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ac49-004c-4e8f-8f41-c65c1316adf1 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:26.944369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 865/1726] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:26.945465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685ac49-004c-4e8f-8f41-c65c1316adf1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:26.947555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b685ac49-004c-4e8f-8f41-c65c1316adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:26.969327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685ac49-004c-4e8f-8f41-c65c1316adf1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:26.974705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:26.975461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:26.975746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:26.976022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:26.987956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:26.989496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:26.999581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 866/1727] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:27.000477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:27.009957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107c9a-d82c-4aca-a193-689140ee39a8 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:27.014854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:27.015609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.015894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.016319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.032287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 862/1728] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:26 2022] POST /identity/v3/projects => generated 403 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:27.033763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.034057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.034320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.037758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:27.039486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:27.061487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 867/1729] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:27.062886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:27.084014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:27.084401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570cf1a-4318-4167-a23a-c964ba13a349 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:27.085296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:27.250514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 863/1730] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:27.273896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:27.277594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:27.294309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:27.295146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.295491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.295731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.300688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:27.307756 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:27.317392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c17ed4-ae63-473c-a26d-be5daf0424d7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:27.342532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:27.342929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:27.345006 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.350297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.350297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.368919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:27.378362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:27.445953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 864/1731] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:27.495226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 868/1732] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:27 2022] POST /identity/v3/users => generated 308 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:27.499406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:27.515126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b0868-fdb0-428f-ba75-1159b951ec6e service placement] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:27.522809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:27.523459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.524059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.524395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.525736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:27.528389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:27.552533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:27.557250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 865/1733] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:27.573234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e61da-2d57-4694-a7d3-d7dd917ffef7 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:27.579537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:27.580229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.580516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.580848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] PATH_INFO: `/v3/projects/f99edf109fb54eeebbb2aebf780b15ac/users/27bace72a5a944aaae7b9167c166dcc3/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.604279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99edf109fb54eeebbb2aebf780b15ac, user_id=27bace72a5a944aaae7b9167c166dcc3, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:27.608466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:27.752402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 869/1734] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:27 2022] PUT /identity/v3/projects/f99edf109fb54eeebbb2aebf780b15ac/users/27bace72a5a944aaae7b9167c166dcc3/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:27.757213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:27.784626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972fe3a-c1fe-4263-8c5b-d5b35138a19f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.008070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.011274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.013364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.013864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.014381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.015546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.020396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.035306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 866/1735] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:28.039301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.071286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe606-1f45-4f3d-8b45-829722bad1cd admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.089561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf535345-834e-475f-99c4-ac2604d2f81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.113832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535345-834e-475f-99c4-ac2604d2f81f admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.113832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535345-834e-475f-99c4-ac2604d2f81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.113832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535345-834e-475f-99c4-ac2604d2f81f admin admin] PATH_INFO: `/v3/projects/f99edf109fb54eeebbb2aebf780b15ac/users/27bace72a5a944aaae7b9167c166dcc3/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.113832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf535345-834e-475f-99c4-ac2604d2f81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99edf109fb54eeebbb2aebf780b15ac, user_id=27bace72a5a944aaae7b9167c166dcc3, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.113832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf535345-834e-475f-99c4-ac2604d2f81f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.132479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 867/1736] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:28 2022] PUT /identity/v3/projects/f99edf109fb54eeebbb2aebf780b15ac/users/27bace72a5a944aaae7b9167c166dcc3/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:28.147854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.148135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.148543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.172257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188045a3-9453-4cbb-a05e-254c97af2353 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.281262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] MFA Rules not processed for user `27bace72a5a944aaae7b9167c166dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:28.289394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:28.420267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dff60-829d-4627-8e7c-8ad041237ba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.421763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dff60-829d-4627-8e7c-8ad041237ba8 service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.423704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dff60-829d-4627-8e7c-8ad041237ba8 service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.424400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dff60-829d-4627-8e7c-8ad041237ba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.430884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-941dff60-829d-4627-8e7c-8ad041237ba8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:28.462382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dff60-829d-4627-8e7c-8ad041237ba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.465800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dff60-829d-4627-8e7c-8ad041237ba8 service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.492358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 870/1737] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:30:28.512541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddc739-8f94-4001-8cba-f82a102a2dbf None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.512541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddc739-8f94-4001-8cba-f82a102a2dbf None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.512541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddc739-8f94-4001-8cba-f82a102a2dbf None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.519550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 868/1738] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:28.521693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.529261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:28.530088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 871/1739] 10.222.0.50 () {54 vars in 961 bytes} [Mon Aug 29 21:30:28 2022] GET /identity => generated 270 bytes in 38 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:28.544429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.544801 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.545228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.666210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:28.675545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:28.701024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 872/1740] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Aug 29 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:28.702044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.726009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:28.854452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a91e2d-2dac-4eb9-8d2c-a85418542d10 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.868851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.870382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.873616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.874222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.898535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.900196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.942015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 869/1741] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:28.942919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.995645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a7c2f-5663-44de-8661-58ea33713af0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.998586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3b381-b401-4109-8a4e-bc91231d3d95 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:29.007549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:29.008811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:29.009190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:29.009984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] PATH_INFO: `/v3/projects/188778089e11494ba4cdd4449c0d8885` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:29.014721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] RBAC: Authorizing `identity:delete_project(project_id=188778089e11494ba4cdd4449c0d8885)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:29.025700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:29.028618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a882e22-20e7-4f40-85ee-63f8a2cd8f3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:29.034557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a882e22-20e7-4f40-85ee-63f8a2cd8f3d service placement] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:29.076324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a882e22-20e7-4f40-85ee-63f8a2cd8f3d service placement] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:29.076324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a882e22-20e7-4f40-85ee-63f8a2cd8f3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:29.101083 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a882e22-20e7-4f40-85ee-63f8a2cd8f3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:29.102864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a882e22-20e7-4f40-85ee-63f8a2cd8f3d service placement] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:29.173583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 870/1742] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:29.175505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518017-a387-42c1-82b3-0d7ac61615f1 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:29.175860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518017-a387-42c1-82b3-0d7ac61615f1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:29.182311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518017-a387-42c1-82b3-0d7ac61615f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:29.268337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-6b518017-a387-42c1-82b3-0d7ac61615f1 None None] MFA Rules not processed for user `f2d41981110c4b6c81239329efb127e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:29.270060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6b518017-a387-42c1-82b3-0d7ac61615f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:29.329855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:29.398173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188778089e11494ba4cdd4449c0d8885', 'request_id': 'req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:29.468930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 871/1743] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:29.473172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b518017-a387-42c1-82b3-0d7ac61615f1 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:29.528180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b518017-a387-42c1-82b3-0d7ac61615f1 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:29.547569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188778089e11494ba4cdd4449c0d8885', 'request_id': 'req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:29.559870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188778089e11494ba4cdd4449c0d8885', 'request_id': 'req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:29.582748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] The token cache is being invalidate because project 188778089e11494ba4cdd4449c0d8885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:29.583602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:29.586696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:29.598856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 873/1744] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:28 2022] DELETE /identity/v3/projects/188778089e11494ba4cdd4449c0d8885 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:29.604096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:29.610027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:29.888851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa07e0-6f1f-4f16-be66-0a2fc1f6157e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:29.896310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:29.898829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:29.898829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:29.898829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] PATH_INFO: `/v3/users/da9226914b3d44a8bfcde93e1acc505e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:29.900072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9226914b3d44a8bfcde93e1acc505e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:29.903570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:29.945318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:29.967060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:29.971770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:29.972241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:29.974118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] PATH_INFO: `/v3/users/e7c216a002d94ac9829c63754a55f625` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:29.977578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c216a002d94ac9829c63754a55f625)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:29.981930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:30.284197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9226914b3d44a8bfcde93e1acc505e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.326354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9226914b3d44a8bfcde93e1acc505e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.327670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9226914b3d44a8bfcde93e1acc505e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.350628 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9226914b3d44a8bfcde93e1acc505e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.409253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c216a002d94ac9829c63754a55f625'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.441743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c216a002d94ac9829c63754a55f625'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.454288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c216a002d94ac9829c63754a55f625'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.547846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-408d9304-0f1a-47f6-9742-2826a49cf9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9226914b3d44a8bfcde93e1acc505e'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.562372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 874/1745] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:29 2022] DELETE /identity/v3/users/da9226914b3d44a8bfcde93e1acc505e => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:30.781815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c216a002d94ac9829c63754a55f625'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.782503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-67cf03ec-8717-4658-9a31-ffdebda1b995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c216a002d94ac9829c63754a55f625'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:30.793183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 872/1746] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:29 2022] DELETE /identity/v3/users/e7c216a002d94ac9829c63754a55f625 => generated 0 bytes in 1323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:30.801206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:30.801206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:30.801206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:30.895919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:30.897594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:30.996248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3140f-004e-45b7-b6b0-0a99dcd3e225 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:30.996861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3140f-004e-45b7-b6b0-0a99dcd3e225 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.000370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3140f-004e-45b7-b6b0-0a99dcd3e225 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:31.008732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 873/1747] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:30:30 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:31.038768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a4e1-4173-4ef9-8eea-94ad9b62452a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:31.039494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a4e1-4173-4ef9-8eea-94ad9b62452a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.039792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a4e1-4173-4ef9-8eea-94ad9b62452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:31.076347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a547a4e1-4173-4ef9-8eea-94ad9b62452a None None] MFA Rules not processed for user `62ffefb33aa940f3a6634ed6745e16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:31.078408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a547a4e1-4173-4ef9-8eea-94ad9b62452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:31.135447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 875/1748] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:31.156015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:31.162687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:31.357388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 874/1749] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:31.357388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:31.357388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.357388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:31.388897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b6c2-300d-402d-887a-7ab8bd723e64 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:31.395639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:31.396574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:31.398270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.398270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:31.426632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] MFA Rules not processed for user `b13474d8ec71457db4fa030d40ab8751`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:31.430537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:31.450139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:31.454519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:31.487860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 876/1750] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:31.495488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:31.502302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:31.535709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148ce2-d832-4260-bde2-7374a6657e68 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:31.551062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:31.553989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:31.554719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.557292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] PATH_INFO: `/v3/users/626d0629e8114569bb88e93c46dfabe3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:31.559702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626d0629e8114569bb88e93c46dfabe3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:31.569541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:31.683259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 875/1751] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:31.685599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:31.700259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:31.970811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2a8d-26a1-4602-ad43-033961749fd6 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:31.996229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:31.996885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:31.997475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.997475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:32.010693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626d0629e8114569bb88e93c46dfabe3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:32.011869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:32.078321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626d0629e8114569bb88e93c46dfabe3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:32.082257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626d0629e8114569bb88e93c46dfabe3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:32.102794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626d0629e8114569bb88e93c46dfabe3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:32.219877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626d0629e8114569bb88e93c46dfabe3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:32.248172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 877/1752] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:31 2022] DELETE /identity/v3/users/626d0629e8114569bb88e93c46dfabe3 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:32.251168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:32.254645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:32.362706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:32.365427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:32.427628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 876/1753] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:32.633322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:32.679592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8c12d-abbe-406a-bbc1-b442f7f853f9 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:32.721055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:32.721752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:32.722613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:32.722911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:32.729666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:32.760079 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:32.762276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:32.836569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 878/1754] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:33.170218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:33.172131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:33.209330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2fa6-6f38-49d8-ab3b-fa901a37342d service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:33.399800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:33.404815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:33.442122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:33.449878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:33.452271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:33.453494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] PATH_INFO: `/v3/projects/c53ef804af194827852803bee643ccbe` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:33.464291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53ef804af194827852803bee643ccbe)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:33.472485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:33.760364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53ef804af194827852803bee643ccbe', 'request_id': 'req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:33.767981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76f10-6a73-42e5-98ac-3a068ee23e61 service placement] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:33.782689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53ef804af194827852803bee643ccbe', 'request_id': 'req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:33.799999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53ef804af194827852803bee643ccbe', 'request_id': 'req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:33.995638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:33.996332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:33.996619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:33.996914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] PATH_INFO: `/v3/projects/dae0af5f20e14a15b69c094fe3d60795` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:34.000957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae0af5f20e14a15b69c094fe3d60795)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:34.015500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:34.146058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] The token cache is being invalidate because project c53ef804af194827852803bee643ccbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:34.151935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.151935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.151935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 877/1755] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:33 2022] DELETE /identity/v3/projects/c53ef804af194827852803bee643ccbe => generated 0 bytes in 979 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:34.151935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:34.151935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:34.175167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0c644-8fe3-4f1b-bee0-b08e89a6421b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:34.182597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:34.183819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:34.184570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:34.187086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] PATH_INFO: `/v3/projects/1ed2ead386154910a439dd1db99fd27a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:34.189725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed2ead386154910a439dd1db99fd27a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:34.191866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:34.372196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae0af5f20e14a15b69c094fe3d60795', 'request_id': 'req-a377088c-abfb-42e2-95b3-aa9ef761b30f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.398738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:34.430556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed2ead386154910a439dd1db99fd27a', 'request_id': 'req-2fa5d803-cd1c-408e-a222-97a279c1e0ac'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.440938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed2ead386154910a439dd1db99fd27a', 'request_id': 'req-2fa5d803-cd1c-408e-a222-97a279c1e0ac'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.450704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed2ead386154910a439dd1db99fd27a', 'request_id': 'req-2fa5d803-cd1c-408e-a222-97a279c1e0ac'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.500777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae0af5f20e14a15b69c094fe3d60795', 'request_id': 'req-a377088c-abfb-42e2-95b3-aa9ef761b30f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.510016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae0af5f20e14a15b69c094fe3d60795', 'request_id': 'req-a377088c-abfb-42e2-95b3-aa9ef761b30f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.543159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] The token cache is being invalidate because project dae0af5f20e14a15b69c094fe3d60795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:34.550481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.554140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a377088c-abfb-42e2-95b3-aa9ef761b30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.558794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 879/1756] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:33 2022] DELETE /identity/v3/projects/dae0af5f20e14a15b69c094fe3d60795 => generated 0 bytes in 1160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:34.562087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:34.562443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:34.562642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:34.622824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:34.629707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:34.671805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] The token cache is being invalidate because project 1ed2ead386154910a439dd1db99fd27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:34.672264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.673004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:34.678610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 878/1757] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:34 2022] DELETE /identity/v3/projects/1ed2ead386154910a439dd1db99fd27a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:34.679621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:34.685682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:34.802053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:34.934735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 880/1758] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:34.936043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:34.949395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:34.982165 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5d803-cd1c-408e-a222-97a279c1e0ac admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:34.989508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641629-4128-4a58-8622-40d9cf1c4525 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:35.002710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:35.003557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:35.003838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:35.004116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] PATH_INFO: `/v3/users/27bace72a5a944aaae7b9167c166dcc3` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:35.011363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:35.012614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27bace72a5a944aaae7b9167c166dcc3)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:35.013642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:35.015913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:35.017785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:35.018251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] PATH_INFO: `/v3/users/841c9ed0e5534a04989c3c6cc6c5a360` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:35.020869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=841c9ed0e5534a04989c3c6cc6c5a360)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:35.026767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:35.539274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841c9ed0e5534a04989c3c6cc6c5a360'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.549686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27bace72a5a944aaae7b9167c166dcc3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.566405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841c9ed0e5534a04989c3c6cc6c5a360'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.567617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841c9ed0e5534a04989c3c6cc6c5a360'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.574520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27bace72a5a944aaae7b9167c166dcc3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.581236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841c9ed0e5534a04989c3c6cc6c5a360'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.590853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27bace72a5a944aaae7b9167c166dcc3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.727055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8e6166cb-cc39-4da2-892d-fc50b6e92bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841c9ed0e5534a04989c3c6cc6c5a360'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.742335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 881/1759] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:34 2022] DELETE /identity/v3/users/841c9ed0e5534a04989c3c6cc6c5a360 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:35.744234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:35.744891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:35.745353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:35.778583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:35.780019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:35.849019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27bace72a5a944aaae7b9167c166dcc3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.850642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27bace72a5a944aaae7b9167c166dcc3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:35.878944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 879/1760] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:34 2022] DELETE /identity/v3/users/27bace72a5a944aaae7b9167c166dcc3 => generated 0 bytes in 1200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:35.969441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 882/1761] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:35.993349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:36.476079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7c92e-2132-404d-bdfe-f0ebb97a070c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:36.489916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:36.492319 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:36.565179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:36.566176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:36.569918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:36.573505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:36.575708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:36.576572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:36.586480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:36.589354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff39073-0244-498d-9d4f-6601153d6a42 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:36.616765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:36.621152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:36.621678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:36.624238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] PATH_INFO: `/v3/projects/401f40d96d0944b699c5191292774193` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:36.646148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=401f40d96d0944b699c5191292774193)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:36.651492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:36.656608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 880/1762] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 682 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:36.665091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:36.703265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e8ac1-01e6-4504-87c2-6031dceb4913 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:36.722498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:36.723582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:36.724158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:36.724641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:36.726101 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:36.731880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:37.004243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 881/1763] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:36 2022] POST /identity/v3/projects => generated 367 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:37.005331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:37.007683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401f40d96d0944b699c5191292774193', 'request_id': 'req-141072e2-2484-4fdc-ac6d-a002495359e0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:37.201462 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:37.295731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401f40d96d0944b699c5191292774193', 'request_id': 'req-141072e2-2484-4fdc-ac6d-a002495359e0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:37.351583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401f40d96d0944b699c5191292774193', 'request_id': 'req-141072e2-2484-4fdc-ac6d-a002495359e0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:37.447262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f417-47ac-4170-8b99-fdbd3c079c7f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:37.459740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] The token cache is being invalidate because project 401f40d96d0944b699c5191292774193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:37.459740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:37.465865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-141072e2-2484-4fdc-ac6d-a002495359e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:37.470414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 883/1764] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:36 2022] DELETE /identity/v3/projects/401f40d96d0944b699c5191292774193 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:30:37.480087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:37.480436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:37.480680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:37.505895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df412-d1a1-4734-86bf-76541789e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:37.510590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df412-d1a1-4734-86bf-76541789e018 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:37.511823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df412-d1a1-4734-86bf-76541789e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:37.513479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df412-d1a1-4734-86bf-76541789e018 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:37.517440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9df412-d1a1-4734-86bf-76541789e018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:37.526953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9df412-d1a1-4734-86bf-76541789e018 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:37.550760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:37.552016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:37.579773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 884/1765] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:37.581200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:37.591341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:37.630730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53de6e-d491-41cd-b670-6af65dce0127 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:37.673378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:37.676338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:37.677054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:37.677378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:37.678075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] PATH_INFO: `/v3/projects/f99edf109fb54eeebbb2aebf780b15ac` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:37.680699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99edf109fb54eeebbb2aebf780b15ac)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:37.693892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:37.705578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 882/1766] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:37 2022] POST /identity/v3/users => generated 284 bytes in 701 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:37.715593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:37.716130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:37.716618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:37.775540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:37.777106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:37.795572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 883/1767] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:37.805798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:37.810209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:37.831681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0f2bd-8672-41de-aa37-65883d5c719d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:37.840364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:37.841359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:37.841850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:37.842321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:37.843317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:37.845767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:37.939822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 884/1768] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:37.943111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:37.975096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bcced-1f57-4731-97fe-8448efede89a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:37.984930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:37.991364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:37.998796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:38.001951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:38.004997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:38.007115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:38.015054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:38.079798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 885/1769] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:38.081025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:38.086953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99edf109fb54eeebbb2aebf780b15ac', 'request_id': 'req-bb633aba-be6e-41c6-a4a7-4df5471a8e57'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:38.112368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578d4cb-1b63-4453-ae16-8cd5468af712 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:38.305320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99edf109fb54eeebbb2aebf780b15ac', 'request_id': 'req-bb633aba-be6e-41c6-a4a7-4df5471a8e57'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:38.315839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99edf109fb54eeebbb2aebf780b15ac', 'request_id': 'req-bb633aba-be6e-41c6-a4a7-4df5471a8e57'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:38.345500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96437c6-d83d-4efa-bd77-4dd405f127df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:38.345500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96437c6-d83d-4efa-bd77-4dd405f127df admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:38.345500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96437c6-d83d-4efa-bd77-4dd405f127df admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:38.345500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96437c6-d83d-4efa-bd77-4dd405f127df admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:38.345871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96437c6-d83d-4efa-bd77-4dd405f127df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:38.346998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] The token cache is being invalidate because project f99edf109fb54eeebbb2aebf780b15ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:30:38.347356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:38.347568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96437c6-d83d-4efa-bd77-4dd405f127df admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:38.349240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:38.353564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 885/1770] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:37 2022] DELETE /identity/v3/projects/f99edf109fb54eeebbb2aebf780b15ac => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:38.381552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 886/1771] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:38.381703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:38.381783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f307-ea83-48f1-bebf-07e34653419b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:38.381783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f307-ea83-48f1-bebf-07e34653419b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:38.381783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f307-ea83-48f1-bebf-07e34653419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:38.381951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:38.436435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633aba-be6e-41c6-a4a7-4df5471a8e57 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:38.468572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:38.469379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:38.469667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:38.470123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:38.470936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:38.473743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:38.502733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ffb7f307-ea83-48f1-bebf-07e34653419b None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:38.504320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ffb7f307-ea83-48f1-bebf-07e34653419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:38.712062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 886/1772] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:38 2022] POST /identity/v3/projects => generated 365 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:38.713037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 887/1773] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:30:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:38.719923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fe42c-1d37-43dd-9215-05224c3088e2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:38.721580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:38.722627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fe42c-1d37-43dd-9215-05224c3088e2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:38.724499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fe42c-1d37-43dd-9215-05224c3088e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:38.731713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:38.845730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-355fe42c-1d37-43dd-9215-05224c3088e2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:38.855750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-355fe42c-1d37-43dd-9215-05224c3088e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:39.054015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 888/1774] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:39.071706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fe42c-1d37-43dd-9215-05224c3088e2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:39.080163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7e50-162d-4826-8cc1-4f2ae850542b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:39.127118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:39.128412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.128837 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.129198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fe42c-1d37-43dd-9215-05224c3088e2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:39.129356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] PATH_INFO: `/v3/projects/ad3968847cb34b70b56bec92f7f597a4/users/36c7f097b90d4fddbf384409ef06f798/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.181657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76bb4e-2b18-481d-8ea6-d43fb6bc33c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:39.202727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76bb4e-2b18-481d-8ea6-d43fb6bc33c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.202727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76bb4e-2b18-481d-8ea6-d43fb6bc33c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.202727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76bb4e-2b18-481d-8ea6-d43fb6bc33c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.202727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76bb4e-2b18-481d-8ea6-d43fb6bc33c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:39.211126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76bb4e-2b18-481d-8ea6-d43fb6bc33c6 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:39.262910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3968847cb34b70b56bec92f7f597a4, user_id=36c7f097b90d4fddbf384409ef06f798, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:39.269155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:39.401042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 889/1775] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:39 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:39.403023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.403310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.403623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.432714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:39.440418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:39.445633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 890/1776] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:39.447206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:39.449198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:39.485095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 887/1777] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:38 2022] PUT /identity/v3/projects/ad3968847cb34b70b56bec92f7f597a4/users/36c7f097b90d4fddbf384409ef06f798/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:39.486621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:39.667923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efad31-05fa-40e3-a615-78aa7058461c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:39.700670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde293a8-ac37-4319-8afe-16c0bd6f9646 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:39.714741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:39.716359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.716769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.717269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.717977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:39.721657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:39.742306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 888/1778] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:39.742306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:39.762646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82a8d-af4b-4f12-b647-3c55833a455c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:39.773565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee902cf-46ae-40cd-86a1-82f9ecea3b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:39.780358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee902cf-46ae-40cd-86a1-82f9ecea3b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.780358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee902cf-46ae-40cd-86a1-82f9ecea3b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.780358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee902cf-46ae-40cd-86a1-82f9ecea3b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.780358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee902cf-46ae-40cd-86a1-82f9ecea3b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:39.780358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee902cf-46ae-40cd-86a1-82f9ecea3b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:39.785778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee902cf-46ae-40cd-86a1-82f9ecea3b5f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:39.804836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:39.804836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.804836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.804836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.861684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 889/1779] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:39.864272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90283436-1eb6-496c-bf78-daba02f8c5be None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.864559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90283436-1eb6-496c-bf78-daba02f8c5be None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.865860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90283436-1eb6-496c-bf78-daba02f8c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.938682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:39.945466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-90283436-1eb6-496c-bf78-daba02f8c5be None None] MFA Rules not processed for user `36c7f097b90d4fddbf384409ef06f798`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:39.945466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-90283436-1eb6-496c-bf78-daba02f8c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:39.945857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:39.967742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 891/1780] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:30:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:30:39.968992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:40.067063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacc8d2-ba3c-4c4a-b672-f8fdc0a90efd service swift] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:40.070685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:40.124787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:40.125490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:40.125762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:40.126040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:40.126724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:40.128704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:40.203700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 892/1781] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:40.204827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:40.224439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 890/1782] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:40.225386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90283436-1eb6-496c-bf78-daba02f8c5be None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:40.258623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc6ab9-9418-4015-833f-c8b6b657526c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:40.271518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce82d2-5349-4f6d-8447-a9c0e06c6834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:40.276060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce82d2-5349-4f6d-8447-a9c0e06c6834 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:40.277772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce82d2-5349-4f6d-8447-a9c0e06c6834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:40.278279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce82d2-5349-4f6d-8447-a9c0e06c6834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:40.278577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90283436-1eb6-496c-bf78-daba02f8c5be None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:40.280766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce82d2-5349-4f6d-8447-a9c0e06c6834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:40.295501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:40.297977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce82d2-5349-4f6d-8447-a9c0e06c6834 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:40.299124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:40.301497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:40.302796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] PATH_INFO: `/v3/projects/db0f1da8279d4e309aadaaef8f5163e9/users/b5a1249b5a394492b98778c09481d57c/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:40.406643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0f1da8279d4e309aadaaef8f5163e9, user_id=b5a1249b5a394492b98778c09481d57c, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:40.416427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:40.845916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 891/1783] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:40 2022] PUT /identity/v3/projects/db0f1da8279d4e309aadaaef8f5163e9/users/b5a1249b5a394492b98778c09481d57c/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:40.862035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:40.871237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 893/1784] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:40 2022] POST /identity/v3/projects => generated 379 bytes in 667 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:40.875279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e72848-9333-424a-855c-11ddd90a5b73 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:40.880588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e72848-9333-424a-855c-11ddd90a5b73 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:40.891395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e72848-9333-424a-855c-11ddd90a5b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:41.110557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-52e72848-9333-424a-855c-11ddd90a5b73 None None] MFA Rules not processed for user `b5a1249b5a394492b98778c09481d57c`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:41.118169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-52e72848-9333-424a-855c-11ddd90a5b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:41.230955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863cebc-724a-417f-a5d7-38ff06536a5a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:41.413234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 894/1785] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:41.418592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e72848-9333-424a-855c-11ddd90a5b73 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:41.592550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:41.600861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:41.605659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:41.610874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:41.614913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:41.620548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:41.701220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e72848-9333-424a-855c-11ddd90a5b73 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:41.713207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:41.714432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:41.715537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:41.725404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:41.726957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:41.735277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:41.838196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 892/1786] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:40 2022] POST /identity/v3/projects => generated 369 bytes in 978 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:41.838196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:41.874139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 895/1787] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:41 2022] POST /identity/v3/users => generated 290 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:41.874139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:41.896473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa25e97-f5f6-4c07-9727-f50b6eaeea57 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:42.066673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583f83d-5d7d-45ec-8895-a31d553b7f0d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:42.084599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:42.089030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.091029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.098822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.098822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:42.098822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:42.162236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed384ae-69f8-4b9e-a7a8-613c6b7049d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:42.162236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed384ae-69f8-4b9e-a7a8-613c6b7049d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.171544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed384ae-69f8-4b9e-a7a8-613c6b7049d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.178912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed384ae-69f8-4b9e-a7a8-613c6b7049d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.192660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed384ae-69f8-4b9e-a7a8-613c6b7049d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:42.202855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed384ae-69f8-4b9e-a7a8-613c6b7049d5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:42.396570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:42.411741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 896/1788] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:41 2022] POST /identity/v3/users => generated 291 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:42.430286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 893/1789] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:41 2022] POST /identity/v3/projects => generated 365 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:42.440155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846ac5-297d-41cd-9fd6-b11d9626a68a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.440379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:42.440529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846ac5-297d-41cd-9fd6-b11d9626a68a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.440529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846ac5-297d-41cd-9fd6-b11d9626a68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.564973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-af846ac5-297d-41cd-9fd6-b11d9626a68a None None] MFA Rules not processed for user `e72f7d1f9961446c8938e3f161fb03f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:42.567118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-af846ac5-297d-41cd-9fd6-b11d9626a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:42.739158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ea1d-a15a-4040-94a6-6db23fea828f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:42.763232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:42.763232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.763232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.763680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.764875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:42.772658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:42.777542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 897/1790] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Aug 29 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:42.783144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846ac5-297d-41cd-9fd6-b11d9626a68a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:42.838002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 894/1791] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:42.842604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:42.891573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14002c47-e0d3-4544-8694-bf17a84db37d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:42.897839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846ac5-297d-41cd-9fd6-b11d9626a68a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:42.904946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:42.906988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.907840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.908816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.910293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:42.923762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:42.942324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:42.943063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.943409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.945774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.946573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:42.949097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:42.994820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 898/1792] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:43.008629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.018532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:43.061762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f7be4-ef97-4ea3-be02-50ae73d2c523 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.067123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.068210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.068588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.069205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.082519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.088398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:43.089699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 895/1793] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:42 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:43.094744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.099099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 899/1794] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:43.100151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.119292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e448a6c-21cf-4e19-a909-94833152c1ac service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.122394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af77f-62f9-419b-9497-01eb4c4c1dbc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.128280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.128280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.131676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.131676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.131954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.131954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.131954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.131954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.132962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.134490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:43.152625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.163312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:43.163767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 900/1795] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:43.163767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:43.164544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.184189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010421-dcf2-4699-8d37-68e1a8300a51 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.186172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 896/1796] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:43.193257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.210275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.211997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.212826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.213963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] PATH_INFO: `/v3/projects/98ba5522228a4103bf517e5ec3bd45f4/users/dfe1aa2e07944c279518a368ef822099/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.223061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c934a-a88e-40ed-83c5-138bb1b2e470 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.254200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.257825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.257825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.259674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ba5522228a4103bf517e5ec3bd45f4, user_id=dfe1aa2e07944c279518a368ef822099, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.261556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.262754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:43.265567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.271254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:43.303356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 897/1797] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:43.305023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.325786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291c42-9d44-48bb-9987-321829da62fd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.350197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.354723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.355365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.356283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] PATH_INFO: `/v3/projects/5464c931826f485f9019d8f680b75c3a/users/c3fd27c9301c4b93815036b0c5a5240e/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.403927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464c931826f485f9019d8f680b75c3a, user_id=c3fd27c9301c4b93815036b0c5a5240e, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.408061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:43.457371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 901/1798] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:43 2022] PUT /identity/v3/projects/98ba5522228a4103bf517e5ec3bd45f4/users/dfe1aa2e07944c279518a368ef822099/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:43.458995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.592040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 898/1799] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:43 2022] PUT /identity/v3/projects/5464c931826f485f9019d8f680b75c3a/users/c3fd27c9301c4b93815036b0c5a5240e/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:43.594418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:43.687319 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93ec57-64b2-487c-98d3-862ba61aebd9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.843250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69d5c-61e3-4c5b-8cc0-ebd654053c89 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:43.872574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65862048-ebb8-4cbb-8c60-2dc2749d666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.876001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65862048-ebb8-4cbb-8c60-2dc2749d666f admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.876001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65862048-ebb8-4cbb-8c60-2dc2749d666f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.878119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65862048-ebb8-4cbb-8c60-2dc2749d666f admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.879007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65862048-ebb8-4cbb-8c60-2dc2749d666f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.887100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65862048-ebb8-4cbb-8c60-2dc2749d666f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:43.916175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:43.919434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.919791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.920020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] PATH_INFO: `/v3/projects/9f70e8fe0e8449b885e2ce7ecf57e00c/users/3724419a9c1b43ad97381c112fc771ea/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.929029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 899/1800] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:43.935130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fa9f-1120-4f61-8c1e-a2d815f8ae8e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:43.946090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fa9f-1120-4f61-8c1e-a2d815f8ae8e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:43.946090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fa9f-1120-4f61-8c1e-a2d815f8ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:43.968665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f70e8fe0e8449b885e2ce7ecf57e00c, user_id=3724419a9c1b43ad97381c112fc771ea, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:43.977193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:44.006997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f110fa9f-1120-4f61-8c1e-a2d815f8ae8e None None] MFA Rules not processed for user `c3fd27c9301c4b93815036b0c5a5240e`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:44.008956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f110fa9f-1120-4f61-8c1e-a2d815f8ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:44.085410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 902/1801] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:43 2022] PUT /identity/v3/projects/9f70e8fe0e8449b885e2ce7ecf57e00c/users/3724419a9c1b43ad97381c112fc771ea/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:44.086623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:44.171727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 900/1802] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:44.176473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110fa9f-1120-4f61-8c1e-a2d815f8ae8e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:44.205133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110fa9f-1120-4f61-8c1e-a2d815f8ae8e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:44.253811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1149-2758-4953-82b1-51f5c957a328 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:44.270733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:44.270733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:44.270733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:44.270733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] PATH_INFO: `/v3/projects/98ba5522228a4103bf517e5ec3bd45f4/users/dfe1aa2e07944c279518a368ef822099/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:44.271241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ba5522228a4103bf517e5ec3bd45f4, user_id=dfe1aa2e07944c279518a368ef822099, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:44.271241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:44.329721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 903/1803] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:44 2022] PUT /identity/v3/projects/98ba5522228a4103bf517e5ec3bd45f4/users/dfe1aa2e07944c279518a368ef822099/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:44.333484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:44.513203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f177e-b104-4edd-821a-3f7e30720e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:44.513929 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f177e-b104-4edd-821a-3f7e30720e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:44.514238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f177e-b104-4edd-821a-3f7e30720e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:44.514627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f177e-b104-4edd-821a-3f7e30720e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:44.515226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f177e-b104-4edd-821a-3f7e30720e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:44.516891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f177e-b104-4edd-821a-3f7e30720e69 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:44.542921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95cac8-a183-48cd-acf5-661944239831 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:44.572451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 901/1804] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:44.575576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9edd6f-4980-45af-8298-2e3a24cd9f9a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:44.575900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9edd6f-4980-45af-8298-2e3a24cd9f9a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:44.576221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9edd6f-4980-45af-8298-2e3a24cd9f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:44.579805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:44.584418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:44.584418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:44.584418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:44.584418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:44.584418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:44.762793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7f9edd6f-4980-45af-8298-2e3a24cd9f9a None None] MFA Rules not processed for user `dfe1aa2e07944c279518a368ef822099`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:44.764927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7f9edd6f-4980-45af-8298-2e3a24cd9f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:44.768204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 904/1805] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:30:44 2022] POST /identity/v3/projects => generated 381 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:44.771656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:44.884615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:44.928979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 902/1806] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:44.936510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9edd6f-4980-45af-8298-2e3a24cd9f9a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:44.972303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9edd6f-4980-45af-8298-2e3a24cd9f9a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:44.980945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbedc8-3163-44f4-8fd8-0199d1da165a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:44.991763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a45d-b8a4-46cd-80bc-471073b3c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:44.992531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a45d-b8a4-46cd-80bc-471073b3c5cc admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:44.992918 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a45d-b8a4-46cd-80bc-471073b3c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:44.993365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a45d-b8a4-46cd-80bc-471073b3c5cc admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:44.994325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41a45d-b8a4-46cd-80bc-471073b3c5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:44.996583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41a45d-b8a4-46cd-80bc-471073b3c5cc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:44.999026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:45.000944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:45.001453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:45.002136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] PATH_INFO: `/v3/projects/9f70e8fe0e8449b885e2ce7ecf57e00c/users/3724419a9c1b43ad97381c112fc771ea/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:45.006485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f70e8fe0e8449b885e2ce7ecf57e00c, user_id=3724419a9c1b43ad97381c112fc771ea, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:45.017759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:45.081840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 905/1807] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:44 2022] PUT /identity/v3/projects/9f70e8fe0e8449b885e2ce7ecf57e00c/users/3724419a9c1b43ad97381c112fc771ea/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:45.086917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:45.098466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:45.388648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d330fdf-d767-4168-aab1-a27db968682d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:45.415622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:45.418667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:45.423671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:45.424192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:45.683145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 903/1808] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:30:44 2022] POST /identity/v3/users => generated 297 bytes in 750 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:45.683145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:45.708083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:45.708083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:45.775513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:45.776962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:45.796439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 906/1809] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:45.806701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:45.852721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] MFA Rules not processed for user `3724419a9c1b43ad97381c112fc771ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:45.855977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:46.022477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c9d2c-0933-4daa-bda5-7a30e1caae9e service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:46.052388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:46.052955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:46.053622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:46.062637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:46.065661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:46.065661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:46.118312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 907/1810] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:46.119989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:46.157842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464029-88c6-4abb-91de-ea5ac0a9c57c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:46.182991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:46.183875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:46.184310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:46.184618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] PATH_INFO: `/v3/projects/520a53533c184c3783f6b2c68b28c422/users/769e2ccb2de544efb64c5d756eceabf8/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:46.224136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=520a53533c184c3783f6b2c68b28c422, user_id=769e2ccb2de544efb64c5d756eceabf8, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:46.227482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:46.240939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 904/1811] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:46.379292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 908/1812] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:46 2022] PUT /identity/v3/projects/520a53533c184c3783f6b2c68b28c422/users/769e2ccb2de544efb64c5d756eceabf8/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:46.401149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:46.404224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:46.412827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:46.452859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d47f89-abb8-4252-8f00-ad36d305b3ed None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:46.542487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b9c4-0d51-470f-8a96-b3b74fedb64d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:46.552358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:46.556976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:46.558571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:46.559383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:46.561171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:46.565786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:46.600226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 909/1813] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:30:46.601643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:46.635904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca064f54-4d00-4bb6-bafe-f63ac7b594b1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:46.656641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ee9a0-a741-437a-ae25-4620db0806d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:46.657734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ee9a0-a741-437a-ae25-4620db0806d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:46.658144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ee9a0-a741-437a-ae25-4620db0806d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:46.658536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ee9a0-a741-437a-ae25-4620db0806d1 admin admin] PATH_INFO: `/v3/projects/520a53533c184c3783f6b2c68b28c422/users/769e2ccb2de544efb64c5d756eceabf8/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:46.666257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ee9a0-a741-437a-ae25-4620db0806d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520a53533c184c3783f6b2c68b28c422, user_id=769e2ccb2de544efb64c5d756eceabf8, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:46.678230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ee9a0-a741-437a-ae25-4620db0806d1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:46.741858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:46.755355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:46.755355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:46.755355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:46.755828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 910/1814] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:30:46 2022] PUT /identity/v3/projects/520a53533c184c3783f6b2c68b28c422/users/769e2ccb2de544efb64c5d756eceabf8/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:46.755828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de4e6-7261-44ed-87d3-efda96fbcdfe None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:46.755828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de4e6-7261-44ed-87d3-efda96fbcdfe None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:46.755828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de4e6-7261-44ed-87d3-efda96fbcdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:46.902761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-810de4e6-7261-44ed-87d3-efda96fbcdfe None None] MFA Rules not processed for user `769e2ccb2de544efb64c5d756eceabf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:46.902761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-810de4e6-7261-44ed-87d3-efda96fbcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:46.956955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:46.958739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:47.029155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 905/1815] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:47.462676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 911/1816] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 716 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:47.500975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:47.535420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f00599-fb23-49fa-bf86-2ad1a3822d70 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:47.750311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:47.772543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31dc39-61ed-49d1-a678-b776c9336d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:47.776518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31dc39-61ed-49d1-a678-b776c9336d5c service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:47.778406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31dc39-61ed-49d1-a678-b776c9336d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:47.782016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31dc39-61ed-49d1-a678-b776c9336d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:47.820969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31dc39-61ed-49d1-a678-b776c9336d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:47.820969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31dc39-61ed-49d1-a678-b776c9336d5c service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:47.843025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de4e6-7261-44ed-87d3-efda96fbcdfe None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:47.869113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de4e6-7261-44ed-87d3-efda96fbcdfe None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:47.882567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dbd1-9fe3-4a88-a7f7-903cb42e6ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:47.883309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dbd1-9fe3-4a88-a7f7-903cb42e6ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:47.883709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dbd1-9fe3-4a88-a7f7-903cb42e6ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:47.884233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dbd1-9fe3-4a88-a7f7-903cb42e6ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:47.901125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 906/1817] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:48.054867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dbd1-9fe3-4a88-a7f7-903cb42e6ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:48.062810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dbd1-9fe3-4a88-a7f7-903cb42e6ae2 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:48.075413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 912/1818] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:30:48.236560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5b2d-4d9b-4d34-ae65-8e2777bda5d4 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:48.237624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5b2d-4d9b-4d34-ae65-8e2777bda5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:48.238119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5b2d-4d9b-4d34-ae65-8e2777bda5d4 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:48.240046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 907/1819] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:30:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:48.474799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:48.475752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:48.475752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:48.547246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:48.553717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:48.893027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 913/1820] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:49.050066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e5b2d-4d9b-4d34-ae65-8e2777bda5d4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:49.079080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e5b2d-4d9b-4d34-ae65-8e2777bda5d4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:49.089491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840fb3-78cc-449a-b7b8-aa7a3e077d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:49.091447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840fb3-78cc-449a-b7b8-aa7a3e077d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:49.091947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840fb3-78cc-449a-b7b8-aa7a3e077d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:49.092449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840fb3-78cc-449a-b7b8-aa7a3e077d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:49.099390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:49.103088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:49.168104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39b0e-2cde-4622-b379-de00351937cb None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:49.211654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789de13-74b6-4e6e-a24d-d14b5168af11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:49.215018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789de13-74b6-4e6e-a24d-d14b5168af11 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:49.217554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789de13-74b6-4e6e-a24d-d14b5168af11 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:49.219726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789de13-74b6-4e6e-a24d-d14b5168af11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:49.292450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789de13-74b6-4e6e-a24d-d14b5168af11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:49.310539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789de13-74b6-4e6e-a24d-d14b5168af11 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:49.361488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 914/1821] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:49.404631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840fb3-78cc-449a-b7b8-aa7a3e077d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:49.406938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840fb3-78cc-449a-b7b8-aa7a3e077d1e service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:49.444046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 908/1822] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:51.090234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23515-0fd5-428b-95e3-860a205b884a None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:51.091117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23515-0fd5-428b-95e3-860a205b884a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:51.091357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23515-0fd5-428b-95e3-860a205b884a None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:51.094645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 915/1823] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:30:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:51.151936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09ffeb-18d5-4745-86a4-d10ea6ffab32 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:51.153551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09ffeb-18d5-4745-86a4-d10ea6ffab32 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:51.154176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09ffeb-18d5-4745-86a4-d10ea6ffab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:51.261282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5d09ffeb-18d5-4745-86a4-d10ea6ffab32 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:51.261282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5d09ffeb-18d5-4745-86a4-d10ea6ffab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:51.302248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 909/1824] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:51.629809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:51.703992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23515-0fd5-428b-95e3-860a205b884a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:51.749823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23515-0fd5-428b-95e3-860a205b884a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:51.760339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c971c24-97cf-4a4e-b788-7c9603a7c0a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:51.761219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971c24-97cf-4a4e-b788-7c9603a7c0a5 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:51.761654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971c24-97cf-4a4e-b788-7c9603a7c0a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:51.761928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971c24-97cf-4a4e-b788-7c9603a7c0a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:51.785960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c971c24-97cf-4a4e-b788-7c9603a7c0a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:51.791084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c971c24-97cf-4a4e-b788-7c9603a7c0a5 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:51.863213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 916/1825] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:30:54.234927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:57.362405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:58.299326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09ffeb-18d5-4745-86a4-d10ea6ffab32 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:58.300977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:58.377693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09ffeb-18d5-4745-86a4-d10ea6ffab32 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:58.383214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:58.383952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:58.384241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:58.384593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] PATH_INFO: `/v3/users/36c7f097b90d4fddbf384409ef06f798` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:58.386185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c7f097b90d4fddbf384409ef06f798)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:58.388612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:58.668816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c7f097b90d4fddbf384409ef06f798'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:58.690600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c7f097b90d4fddbf384409ef06f798'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:58.691610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c7f097b90d4fddbf384409ef06f798'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:58.700225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c7f097b90d4fddbf384409ef06f798'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:58.938221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c7f097b90d4fddbf384409ef06f798'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:58.939537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 910/1826] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:30:58 2022] DELETE /identity/v3/users/36c7f097b90d4fddbf384409ef06f798 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:58.940085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:58.940755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:58.940967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:58.974386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:58.974386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:59.082454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 917/1827] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:59.101537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:59.103349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:59.170605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d895a-c00f-409b-8a79-244718c08ab8 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:59.175394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:59.176173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:59.176462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:59.176734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:59.189210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:59.190800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:59.212856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 911/1828] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:59.696234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:59.698046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:59.711585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d48961-b795-4b98-bf1c-540e4321fa79 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:59.720983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:59.720983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:59.720983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:59.720983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] PATH_INFO: `/v3/projects/ad3968847cb34b70b56bec92f7f597a4` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:59.722819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3968847cb34b70b56bec92f7f597a4)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:59.724953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:59.920513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3968847cb34b70b56bec92f7f597a4', 'request_id': 'req-5e5dc405-304b-44cc-a818-44ba65eb1641'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:59.930105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3968847cb34b70b56bec92f7f597a4', 'request_id': 'req-5e5dc405-304b-44cc-a818-44ba65eb1641'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:30:59.943699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3968847cb34b70b56bec92f7f597a4', 'request_id': 'req-5e5dc405-304b-44cc-a818-44ba65eb1641'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.142770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] The token cache is being invalidate because project ad3968847cb34b70b56bec92f7f597a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:00.143373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.144243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.146246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 918/1829] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:30:59 2022] DELETE /identity/v3/projects/ad3968847cb34b70b56bec92f7f597a4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:00.151236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:00.162424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6df2f-fece-4ff2-ac1b-c7c2aa9d76b8 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:00.247551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:00.248777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:00.249528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:00.250146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] PATH_INFO: `/v3/users/dfe1aa2e07944c279518a368ef822099` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:00.252023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe1aa2e07944c279518a368ef822099)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:00.254529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:00.561654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe1aa2e07944c279518a368ef822099'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.580933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe1aa2e07944c279518a368ef822099'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.581873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe1aa2e07944c279518a368ef822099'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.591510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe1aa2e07944c279518a368ef822099'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.701434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe1aa2e07944c279518a368ef822099'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:00.716355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 912/1830] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:00 2022] DELETE /identity/v3/users/dfe1aa2e07944c279518a368ef822099 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:01.129451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:01.247437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:01.251631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:01.276074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc405-304b-44cc-a818-44ba65eb1641 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:01.364490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:01.365575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:01.366099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:01.367133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] PATH_INFO: `/v3/projects/98ba5522228a4103bf517e5ec3bd45f4` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:01.368746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ba5522228a4103bf517e5ec3bd45f4)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:01.381513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:01.462765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:01.465295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:01.482404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138dcc9-133e-47fb-8ac1-2f6bd2b54eff admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:01.487652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:01.488300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:01.488577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:01.489001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] PATH_INFO: `/v3/users/8c19eea793574881ab687840b99dc86c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:01.490634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c19eea793574881ab687840b99dc86c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:01.492755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:01.547738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ba5522228a4103bf517e5ec3bd45f4', 'request_id': 'req-2cf70b86-ac73-401a-9c02-e850f2357b88'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.556983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ba5522228a4103bf517e5ec3bd45f4', 'request_id': 'req-2cf70b86-ac73-401a-9c02-e850f2357b88'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.566224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ba5522228a4103bf517e5ec3bd45f4', 'request_id': 'req-2cf70b86-ac73-401a-9c02-e850f2357b88'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.689445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] The token cache is being invalidate because project 98ba5522228a4103bf517e5ec3bd45f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:01.689852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.690546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2cf70b86-ac73-401a-9c02-e850f2357b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.695649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 919/1831] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:01 2022] DELETE /identity/v3/projects/98ba5522228a4103bf517e5ec3bd45f4 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:01.697055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb7f8-fefe-43dc-9a15-7353322ed944 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:01.697428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb7f8-fefe-43dc-9a15-7353322ed944 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:01.697712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb7f8-fefe-43dc-9a15-7353322ed944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:01.718914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2febb7f8-fefe-43dc-9a15-7353322ed944 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:01.720195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2febb7f8-fefe-43dc-9a15-7353322ed944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:01.788298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 920/1832] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:01.825499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b1d3-9d1d-4a36-829d-8aca0282b5a7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:01.825783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b1d3-9d1d-4a36-829d-8aca0282b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:01.826247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b1d3-9d1d-4a36-829d-8aca0282b5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:01.836783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c19eea793574881ab687840b99dc86c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.855747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c19eea793574881ab687840b99dc86c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.856825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c19eea793574881ab687840b99dc86c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.871113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c19eea793574881ab687840b99dc86c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.871304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b405b1d3-9d1d-4a36-829d-8aca0282b5a7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:01.872766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b405b1d3-9d1d-4a36-829d-8aca0282b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:01.890449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 921/1833] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:01.896537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b1d3-9d1d-4a36-829d-8aca0282b5a7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:01.917373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b1d3-9d1d-4a36-829d-8aca0282b5a7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:01.926834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:01.928052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:01.928748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:01.929201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:01.929986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:01.930483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:01.933400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:01.954926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 922/1834] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:31:01.960444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:01.969927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b3a49b93-7062-4d31-83c7-2262f9b2882d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c19eea793574881ab687840b99dc86c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:01.984886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 913/1835] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:01 2022] DELETE /identity/v3/users/8c19eea793574881ab687840b99dc86c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:01.990589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:01.995003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:01.995733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:01.996050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f22b-817d-46e8-9c75-072097af6283 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:02.003043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:02.053764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:02.056350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:02.131948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:02.132603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:02.132956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:02.133297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:02.135340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:02.138529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:02.206331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 914/1836] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:02.225448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:02.229802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:02.262399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 923/1837] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:01 2022] POST /identity/v3/projects => generated 369 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:02.267836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:02.349499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c4ee7-5b7a-4f8e-b453-212da9ec55dc None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:02.376542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549a0e6-3d37-4e08-a0c2-813a32df9564 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:02.383057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:02.384241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:02.384507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:02.384786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:02.386096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:02.388072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:02.409263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:02.409906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:02.410186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:02.410461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:02.421332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:02.422833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:02.433706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 915/1838] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:02.530323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 924/1839] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:02 2022] POST /identity/v3/users => generated 285 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:02.534134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:02.547407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce3b2c-44b7-4595-859c-fcaa28f894a5 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:02.555670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:02.557458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:02.557864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:02.558251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:02.558989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:02.560868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:02.591416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 916/1840] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:02.597429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:02.610290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148710-049d-4769-a5e6-018e4553ba24 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:02.615935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae77cd3-b4b6-435c-928c-2a14f0192b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:02.617502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77cd3-b4b6-435c-928c-2a14f0192b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:02.617978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77cd3-b4b6-435c-928c-2a14f0192b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:02.618585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77cd3-b4b6-435c-928c-2a14f0192b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:02.619768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae77cd3-b4b6-435c-928c-2a14f0192b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:02.621716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae77cd3-b4b6-435c-928c-2a14f0192b93 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:02.642041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 925/1841] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:02.653274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:02.670557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d5ef-6367-49be-87bb-473930f6dbdb admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:02.677545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:02.679261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:02.679833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:02.680070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] PATH_INFO: `/v3/projects/3bc7a45546ec46f48180fd4593d70097/users/d2ceaf99a6e94933951cdd29d507270b/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:02.704809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc7a45546ec46f48180fd4593d70097, user_id=d2ceaf99a6e94933951cdd29d507270b, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:02.709324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:02.904622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 917/1842] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:02 2022] PUT /identity/v3/projects/3bc7a45546ec46f48180fd4593d70097/users/d2ceaf99a6e94933951cdd29d507270b/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:02.906372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:02.906671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:02.907084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:02.968867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] MFA Rules not processed for user `d2ceaf99a6e94933951cdd29d507270b`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:02.970823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:03.079677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 926/1843] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:03.084585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:03.164013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e92ea-b39b-4fa2-9d64-baaf181acdbc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:03.170190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:03.171161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:03.171448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:03.171724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:03.172381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:03.174419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:03.231441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:03.233706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:03.248998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1dd3-ed48-4544-ab4d-e6bd6abcfb14 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:03.259847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:03.266887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:03.266887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:03.266887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] PATH_INFO: `/v3/projects/f847adfd7f0f46f0a7b2ab17dd8850f5` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:03.266887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f847adfd7f0f46f0a7b2ab17dd8850f5)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:03.266887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:03.368369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 918/1844] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:03 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:03.372595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:03.421421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f847adfd7f0f46f0a7b2ab17dd8850f5', 'request_id': 'req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:03.435539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f847adfd7f0f46f0a7b2ab17dd8850f5', 'request_id': 'req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:03.448621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f847adfd7f0f46f0a7b2ab17dd8850f5', 'request_id': 'req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:03.515287 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd06b1-dab9-486e-a321-376ce144bb3c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:03.555850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] The token cache is being invalidate because project f847adfd7f0f46f0a7b2ab17dd8850f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:03.558304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:03.558304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:03.558789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 927/1845] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:03 2022] DELETE /identity/v3/projects/f847adfd7f0f46f0a7b2ab17dd8850f5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:03.563742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:03.567053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:03.608356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:03.609110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:03.609409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:03.609850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:03.610572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:03.613005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:03.678090 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e9e1-8b53-4978-8ea5-016a6a484d81 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:03.699010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:03.701572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:03.705601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:03.705601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] PATH_INFO: `/v3/users/5df23f5bf7b84f8d901bc61673090665` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:03.705601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df23f5bf7b84f8d901bc61673090665)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:03.721565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:03.804905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 919/1846] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:03 2022] POST /identity/v3/users => generated 290 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:03.810305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:03.812434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:03.835321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf206b-74d5-4fcb-8c09-d96c7aa5c59c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:03.842010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:03.842641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:03.842927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:03.843189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:03.843840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:03.845576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:03.865300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 920/1847] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:03.870631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:03.884942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168c20f-6b43-43e9-8b8b-bafa87ed6427 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:03.894831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:03.895615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:03.895902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:03.896652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] PATH_INFO: `/v3/projects/73ed07b78dcc48298b69dcc22defdc51/users/755328babe9a4138b30833aa04678203/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:03.913967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ed07b78dcc48298b69dcc22defdc51, user_id=755328babe9a4138b30833aa04678203, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:03.917502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:04.139205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 921/1848] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:03 2022] PUT /identity/v3/projects/73ed07b78dcc48298b69dcc22defdc51/users/755328babe9a4138b30833aa04678203/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:04.143000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:04.189096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df23f5bf7b84f8d901bc61673090665'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:04.225573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df23f5bf7b84f8d901bc61673090665'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:04.246273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df23f5bf7b84f8d901bc61673090665'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:04.292327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901558e-fc93-4b5a-80ba-5d449b6e65f7 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:04.299085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:04.302266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.302266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.302266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.302266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:04.303317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:04.318116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 922/1849] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:04.319796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:04.330833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03774436-dfe3-4989-a039-f80e64a4c9c6 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:04.334693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df23f5bf7b84f8d901bc61673090665'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:04.337508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8538c544-c9f9-43c9-ba2a-bd3fe61455cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df23f5bf7b84f8d901bc61673090665'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:04.340104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:04.341683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.342168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.343020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] PATH_INFO: `/v3/projects/73ed07b78dcc48298b69dcc22defdc51/users/755328babe9a4138b30833aa04678203/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.345716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ed07b78dcc48298b69dcc22defdc51, user_id=755328babe9a4138b30833aa04678203, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:04.350032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:04.351837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 928/1850] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:03 2022] DELETE /identity/v3/users/5df23f5bf7b84f8d901bc61673090665 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:04.375428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 923/1851] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:04 2022] PUT /identity/v3/projects/73ed07b78dcc48298b69dcc22defdc51/users/755328babe9a4138b30833aa04678203/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:04.386762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3696c7-6149-4f90-9b5e-0e3303439127 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.387321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3696c7-6149-4f90-9b5e-0e3303439127 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.387758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3696c7-6149-4f90-9b5e-0e3303439127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.425980 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-dd3696c7-6149-4f90-9b5e-0e3303439127 None None] MFA Rules not processed for user `755328babe9a4138b30833aa04678203`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:04.427663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-dd3696c7-6149-4f90-9b5e-0e3303439127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:04.521192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 929/1852] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:04.532909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:04.535018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:04.596247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd6f1-07d2-49c6-9057-c05321c35a37 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:04.600116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:04.600711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.600989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.601335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.611955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:04.613658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:04.624814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 924/1853] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:04.813526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3696c7-6149-4f90-9b5e-0e3303439127 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:04.824212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3696c7-6149-4f90-9b5e-0e3303439127 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:04.835002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:04.835895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.836290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.837271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.843734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:04.924600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:04.934670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:04.936741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:04.948687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 930/1854] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:04.974257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:04.976133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.063102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74efb-b743-4ef0-9e0c-22fad23504ca service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:05.068041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:05.068685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.069120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.069909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] PATH_INFO: `/v3/projects/c911d8755491460893064a3cfe06ae0d` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.070531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c911d8755491460893064a3cfe06ae0d)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:05.073286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:05.109932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:05.111295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.130917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83f08-1c40-4016-af06-06cf3279b83c service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:05.136412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:05.137055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.137366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.137644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] PATH_INFO: `/v3/users/b5a1249b5a394492b98778c09481d57c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.138981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a1249b5a394492b98778c09481d57c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:05.140809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:05.268844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:05.290577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c911d8755491460893064a3cfe06ae0d', 'request_id': 'req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.375603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c911d8755491460893064a3cfe06ae0d', 'request_id': 'req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.392166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c911d8755491460893064a3cfe06ae0d', 'request_id': 'req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.407041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] The token cache is being invalidate because project c911d8755491460893064a3cfe06ae0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:05.407335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.408026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-72e2044c-f5ef-4372-b716-f3e8e3efa1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.409624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 925/1855] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:04 2022] DELETE /identity/v3/projects/c911d8755491460893064a3cfe06ae0d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:05.414587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468bec0-ad7b-41c2-9bf6-4c7744f44f5b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.414900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468bec0-ad7b-41c2-9bf6-4c7744f44f5b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.416171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468bec0-ad7b-41c2-9bf6-4c7744f44f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.435933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9468bec0-ad7b-41c2-9bf6-4c7744f44f5b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:05.436976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9468bec0-ad7b-41c2-9bf6-4c7744f44f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.513219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 926/1856] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:05.526601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a8f38-879e-496f-b43e-5d0b66a0b757 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.526886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a8f38-879e-496f-b43e-5d0b66a0b757 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.527157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a8f38-879e-496f-b43e-5d0b66a0b757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.528176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a1249b5a394492b98778c09481d57c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.542527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a1249b5a394492b98778c09481d57c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.564136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a1249b5a394492b98778c09481d57c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.599253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-646a8f38-879e-496f-b43e-5d0b66a0b757 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:05.601250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-646a8f38-879e-496f-b43e-5d0b66a0b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.616082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 927/1857] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:05.620162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a8f38-879e-496f-b43e-5d0b66a0b757 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:05.631361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a8f38-879e-496f-b43e-5d0b66a0b757 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:05.638243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:05.639409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.640103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.641131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.642067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:05.642616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:05.644585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:05.662715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 928/1858] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:31:05.668367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:05.669528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a1249b5a394492b98778c09481d57c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.670510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34773bd3-9711-4df6-80c5-20edccbcb7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a1249b5a394492b98778c09481d57c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:05.679668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 931/1859] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:05 2022] DELETE /identity/v3/users/b5a1249b5a394492b98778c09481d57c => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:05.682336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c4e6-7a9d-4f63-be89-cf195b88a94b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:05.684476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.685184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.685603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.709531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:05.710373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.764375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:05.768223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.768223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.768223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.768223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:05.770768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:05.783418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 932/1860] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:05.792774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:05.797934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.865097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614f162-c865-45e1-9c2e-065f4f407f61 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:05.869514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:05.873402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.873402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.873402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.880689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:05.882329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:05.893323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 933/1861] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:05.895921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:05.895921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.908237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd8f04-8d85-49ed-9fa8-fe9b1444d797 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:05.913204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:05.913833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:05.914110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:05.914380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] PATH_INFO: `/v3/users/c3fd27c9301c4b93815036b0c5a5240e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:05.915549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fd27c9301c4b93815036b0c5a5240e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:05.917818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:05.978694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 929/1862] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:05 2022] POST /identity/v3/projects => generated 407 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:05.992704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:05.999561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:06.124068 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649b98c-78fb-466d-8c03-51500279129e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:06.135696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:06.136712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.137142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.137414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.138268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:06.142410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:06.254117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fd27c9301c4b93815036b0c5a5240e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.270272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fd27c9301c4b93815036b0c5a5240e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.278853 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fd27c9301c4b93815036b0c5a5240e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.289492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 930/1863] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:05 2022] POST /identity/v3/users => generated 304 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:06.292707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:06.307598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da684a90-39df-4860-bf72-1fe4e2a3cfc7 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:06.316747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:06.317874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.318367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.318872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.320079 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:06.324938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:06.352781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 931/1864] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:06.355433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:06.363677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fd27c9301c4b93815036b0c5a5240e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.364682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7ffbe8f9-bf10-4a83-b183-85cc32552ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fd27c9301c4b93815036b0c5a5240e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.373276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256a68d-fd2a-4b0f-adb8-34a24f4667bc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:06.374653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 934/1865] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:05 2022] DELETE /identity/v3/users/c3fd27c9301c4b93815036b0c5a5240e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:06.381014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace20fc-f879-4476-a348-464e671134c7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.381613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace20fc-f879-4476-a348-464e671134c7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.382272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace20fc-f879-4476-a348-464e671134c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.446452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1ace20fc-f879-4476-a348-464e671134c7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:06.457838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1ace20fc-f879-4476-a348-464e671134c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:06.520323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:06.521176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.521463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.521795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.522585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:06.524286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:06.553453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 932/1866] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:06.554700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:06.563436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 935/1867] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:06.564849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:06.567786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ea82-a61e-4c81-b126-9a5057dfd56d None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.568072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ea82-a61e-4c81-b126-9a5057dfd56d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.568350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ea82-a61e-4c81-b126-9a5057dfd56d None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.569884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 936/1868] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:06.570435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ea82-a61e-4c81-b126-9a5057dfd56d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:06.578277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6951ea82-a61e-4c81-b126-9a5057dfd56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:06.593598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599194-e6c8-4a99-9e95-bf99cc5bacdf admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:06.600451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:06.601131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.601820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.602935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] PATH_INFO: `/v3/projects/db0f1da8279d4e309aadaaef8f5163e9` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.604481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0f1da8279d4e309aadaaef8f5163e9)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:06.606721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:06.615500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ea82-a61e-4c81-b126-9a5057dfd56d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:06.632961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:06.634818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.635518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.636563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] PATH_INFO: `/v3/projects/da20f756ba0e46b2831038320a2ddb5a/users/2d937c7f06fd42b1a4fd14e57d4ac6b0/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.663640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da20f756ba0e46b2831038320a2ddb5a, user_id=2d937c7f06fd42b1a4fd14e57d4ac6b0, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:06.666821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:06.760685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 937/1869] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:06 2022] PUT /identity/v3/projects/da20f756ba0e46b2831038320a2ddb5a/users/2d937c7f06fd42b1a4fd14e57d4ac6b0/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:06.763789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:06.769778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:06.790191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0f1da8279d4e309aadaaef8f5163e9', 'request_id': 'req-9e512212-17b1-45b2-be3f-a5617764bb46'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.879558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e8685-d7a3-4a6c-9507-97248180db95 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:06.936779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0f1da8279d4e309aadaaef8f5163e9', 'request_id': 'req-9e512212-17b1-45b2-be3f-a5617764bb46'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.948212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0f1da8279d4e309aadaaef8f5163e9', 'request_id': 'req-9e512212-17b1-45b2-be3f-a5617764bb46'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.955172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818aa7-7e75-4adf-a139-e334bfa3986e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:06.956211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818aa7-7e75-4adf-a139-e334bfa3986e service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.956767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818aa7-7e75-4adf-a139-e334bfa3986e service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.957320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818aa7-7e75-4adf-a139-e334bfa3986e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.963986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] The token cache is being invalidate because project db0f1da8279d4e309aadaaef8f5163e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:06.964612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.965900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9e512212-17b1-45b2-be3f-a5617764bb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:06.967714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 933/1870] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:06 2022] DELETE /identity/v3/projects/db0f1da8279d4e309aadaaef8f5163e9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:06.969978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:06.970259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:06.970542 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:06.996578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:07.000642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.075203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818aa7-7e75-4adf-a139-e334bfa3986e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:07.078240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818aa7-7e75-4adf-a139-e334bfa3986e service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:07.096818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 938/1871] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:07.097865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 934/1872] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:07.097982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.097982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.097982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.098229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:07.099275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.131834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d02413-ed4e-4ef6-91fe-e2aa9548abc2 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:07.132744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] MFA Rules not processed for user `2d937c7f06fd42b1a4fd14e57d4ac6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:07.134858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.138472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:07.139554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.140150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.140676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] PATH_INFO: `/v3/users/3724419a9c1b43ad97381c112fc771ea` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.142329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3724419a9c1b43ad97381c112fc771ea)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:07.144430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:07.249305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 939/1873] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:07.256638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:07.259810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.281854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a44ff-d307-46bd-8f63-471a6b3c15c8 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:07.288806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:07.289545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.290028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.290516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.308404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:07.311861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:07.334633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 940/1874] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:07.335889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:07.337872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.377409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fdef4-ea40-4568-a6b6-43815c413e35 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:07.404585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:07.405280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.405564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.405839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.406517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:07.408557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:07.452394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3724419a9c1b43ad97381c112fc771ea'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:07.474111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3724419a9c1b43ad97381c112fc771ea'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:07.475092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3724419a9c1b43ad97381c112fc771ea'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:07.485513 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3724419a9c1b43ad97381c112fc771ea'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:07.596441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 941/1875] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:07 2022] POST /identity/v3/projects => generated 407 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:07.598158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:07.600899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.602003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3724419a9c1b43ad97381c112fc771ea'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:07.616060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 935/1876] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:07 2022] DELETE /identity/v3/users/3724419a9c1b43ad97381c112fc771ea => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:07.730590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf17e5a-e098-4a18-beff-d5f264c5c712 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:07.742417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:07.867035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:07.869380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.870044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.870674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.871908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:07.874823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.051514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:08.053028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:08.088958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 942/1877] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:07 2022] POST /identity/v3/users => generated 310 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:08.093105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36322ae-7e47-4dcb-99f1-1c439b685b6d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:08.095514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:08.100294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:08.101302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:08.101946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:08.102444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] PATH_INFO: `/v3/projects/5464c931826f485f9019d8f680b75c3a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:08.104935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5464c931826f485f9019d8f680b75c3a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:08.108144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.145978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e666be4-b0d3-4ab9-a4c3-0248c0ff5e85 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:08.160151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:08.161081 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:08.161618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:08.162000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:08.162860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:08.166137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.183992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 943/1878] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:08.186607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:08.216974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92912e0-2226-4813-b2d1-274bbef510e4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:08.216974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:08.216974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:08.216974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:08.218376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] PATH_INFO: `/v3/projects/83d88f98cc9d438cb5ad50f83d7eb0c4/users/c53eab7d5c8b43918f5078ad381083eb/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:08.238308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d88f98cc9d438cb5ad50f83d7eb0c4, user_id=c53eab7d5c8b43918f5078ad381083eb, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:08.241024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.350200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 944/1879] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:08 2022] PUT /identity/v3/projects/83d88f98cc9d438cb5ad50f83d7eb0c4/users/c53eab7d5c8b43918f5078ad381083eb/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:08.355316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:08.363490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5464c931826f485f9019d8f680b75c3a', 'request_id': 'req-67185379-0c9a-4e0d-af3c-b3022c39352b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.444114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2f3d-b8eb-4f7a-b441-4b4d96d6d5e9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:08.501018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5464c931826f485f9019d8f680b75c3a', 'request_id': 'req-67185379-0c9a-4e0d-af3c-b3022c39352b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.511422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5464c931826f485f9019d8f680b75c3a', 'request_id': 'req-67185379-0c9a-4e0d-af3c-b3022c39352b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.518306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:08.519067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:08.519462 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:08.519660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:08.520331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:08.522098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.528595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] The token cache is being invalidate because project 5464c931826f485f9019d8f680b75c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:08.528915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.529603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.531123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 936/1880] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:08 2022] DELETE /identity/v3/projects/5464c931826f485f9019d8f680b75c3a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:08.535498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:08.537137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 945/1881] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:08.537390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:08.538374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:08.540367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:08.551601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185379-0c9a-4e0d-af3c-b3022c39352b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:08.562713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a9cb-4e58-4edf-8a2f-d06156bec6ff admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:08.565685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:08.566670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:08.567153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:08.567812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] PATH_INFO: `/v3/users/769e2ccb2de544efb64c5d756eceabf8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:08.570795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:08.572244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:08.572820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:08.573128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] PATH_INFO: `/v3/projects/83d88f98cc9d438cb5ad50f83d7eb0c4/users/c53eab7d5c8b43918f5078ad381083eb/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:08.573727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=769e2ccb2de544efb64c5d756eceabf8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:08.575552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d88f98cc9d438cb5ad50f83d7eb0c4, user_id=c53eab7d5c8b43918f5078ad381083eb, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:08.576423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.578603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.596506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 946/1882] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:08 2022] PUT /identity/v3/projects/83d88f98cc9d438cb5ad50f83d7eb0c4/users/c53eab7d5c8b43918f5078ad381083eb/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:08.599201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:08.603816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:08.785441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784685b-4e94-47e3-849d-75ee3a7de64b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:08.796558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:08.797965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:08.798416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:08.799137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] PATH_INFO: `/v3/projects/9f70e8fe0e8449b885e2ce7ecf57e00c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:08.800541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f70e8fe0e8449b885e2ce7ecf57e00c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:08.803212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:08.926400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769e2ccb2de544efb64c5d756eceabf8'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.952609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769e2ccb2de544efb64c5d756eceabf8'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.953570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769e2ccb2de544efb64c5d756eceabf8'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.968406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769e2ccb2de544efb64c5d756eceabf8'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.973114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f70e8fe0e8449b885e2ce7ecf57e00c', 'request_id': 'req-e2e1b06e-4936-44c5-a933-c80d26d661d1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.982864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f70e8fe0e8449b885e2ce7ecf57e00c', 'request_id': 'req-e2e1b06e-4936-44c5-a933-c80d26d661d1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:08.994573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f70e8fe0e8449b885e2ce7ecf57e00c', 'request_id': 'req-e2e1b06e-4936-44c5-a933-c80d26d661d1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:09.078920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c61a074-3dcf-4c3d-8012-a72197c9b7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769e2ccb2de544efb64c5d756eceabf8'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:09.101652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 937/1883] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:08 2022] DELETE /identity/v3/users/769e2ccb2de544efb64c5d756eceabf8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:09.104672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.105365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.105845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.161229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] MFA Rules not processed for user `c53eab7d5c8b43918f5078ad381083eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:09.163438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:09.176023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] The token cache is being invalidate because project 9f70e8fe0e8449b885e2ce7ecf57e00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:09.176374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:09.177086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e2e1b06e-4936-44c5-a933-c80d26d661d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:09.184861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 947/1884] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:08 2022] DELETE /identity/v3/projects/9f70e8fe0e8449b885e2ce7ecf57e00c => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:09.186744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235be3a-374c-4701-b504-235cb3fc4d76 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.187127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235be3a-374c-4701-b504-235cb3fc4d76 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.187448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235be3a-374c-4701-b504-235cb3fc4d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.232613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3235be3a-374c-4701-b504-235cb3fc4d76 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:09.239252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3235be3a-374c-4701-b504-235cb3fc4d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:09.346142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 938/1885] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:09.364395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:09.366731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:09.374374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 948/1886] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:09.383850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80e7a8-657a-47bc-959f-d4f2ac6ad5e1 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.384152 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80e7a8-657a-47bc-959f-d4f2ac6ad5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.384498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80e7a8-657a-47bc-959f-d4f2ac6ad5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.405202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:09.410595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-4a80e7a8-657a-47bc-959f-d4f2ac6ad5e1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:09.411893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4a80e7a8-657a-47bc-959f-d4f2ac6ad5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:09.423324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 949/1887] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:09.428302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80e7a8-657a-47bc-959f-d4f2ac6ad5e1 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:09.439161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80e7a8-657a-47bc-959f-d4f2ac6ad5e1 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:09.445788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:09.446493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.446772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.447498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.453747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:09.453747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:09.460562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:09.492007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa43d-3040-4288-9881-d17a554ad7fc None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:09.497108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 950/1888] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:31:09.504596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:09.505259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.505543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.505815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.506335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:09.522262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:09.529047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:09.533818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eff21-20ff-44aa-a673-632fc0a1706a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:09.551764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:09.552490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.552912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.553309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.554870 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:09.555725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 939/1889] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:09 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:09.565847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:09.708714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 951/1890] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:09 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:09.714520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:09.726259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e982a20-e57a-41bd-a878-76b5e509e326 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:09.798243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:09.798864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.799139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.799465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.800067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:09.802486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:09.837245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:09.840063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:09.880415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a4014-6b49-49aa-b62f-572f368876e2 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:09.891852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:09.892496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.892776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.893046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] PATH_INFO: `/v3/projects/520a53533c184c3783f6b2c68b28c422` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.895654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] RBAC: Authorizing `identity:delete_project(project_id=520a53533c184c3783f6b2c68b28c422)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:09.897716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:09.966702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 940/1891] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:09 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:09.969620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:09.985148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73510-b38e-499b-bc4c-e23dad6e4b48 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:09.990764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:09.991390 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.991721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.992467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.993301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:09.994955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.015788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 941/1892] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:10.029529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.041665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574aa6a-c8ab-474f-8143-b46eef3c390b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:10.046764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:10.047435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.048098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.048402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.049089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:10.050498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:10.054783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.086183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520a53533c184c3783f6b2c68b28c422', 'request_id': 'req-0f9b829b-7143-481f-b0ff-eefbcc61997b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:10.091077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 942/1893] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:10.098830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.101620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520a53533c184c3783f6b2c68b28c422', 'request_id': 'req-0f9b829b-7143-481f-b0ff-eefbcc61997b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:10.109972 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520a53533c184c3783f6b2c68b28c422', 'request_id': 'req-0f9b829b-7143-481f-b0ff-eefbcc61997b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:10.115356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e11f-c966-4b47-94b6-9aca2dba2dd3 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:10.193586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] The token cache is being invalidate because project 520a53533c184c3783f6b2c68b28c422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:10.197748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:10.197748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:10.200756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 952/1894] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:09 2022] DELETE /identity/v3/projects/520a53533c184c3783f6b2c68b28c422 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:10.201477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.204626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.252999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b388d-8c4a-4444-8e05-3f116273248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:10.253715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b388d-8c4a-4444-8e05-3f116273248d admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.253990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b388d-8c4a-4444-8e05-3f116273248d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.254257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b388d-8c4a-4444-8e05-3f116273248d admin admin] PATH_INFO: `/v3/projects/de5332d9995d47c3984be1fa5e579b11/users/59011eb1738f4ec6a0f21031a7287920/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.281348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b388d-8c4a-4444-8e05-3f116273248d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5332d9995d47c3984be1fa5e579b11, user_id=59011eb1738f4ec6a0f21031a7287920, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:10.289727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b388d-8c4a-4444-8e05-3f116273248d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.302516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b829b-7143-481f-b0ff-eefbcc61997b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:10.307684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ae6f6-54a1-4e1e-a6a0-78a400e7de70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:10.308678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae6f6-54a1-4e1e-a6a0-78a400e7de70 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.309214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae6f6-54a1-4e1e-a6a0-78a400e7de70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.309545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae6f6-54a1-4e1e-a6a0-78a400e7de70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.311687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0b7ae6f6-54a1-4e1e-a6a0-78a400e7de70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.377664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 943/1895] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:10 2022] PUT /identity/v3/projects/de5332d9995d47c3984be1fa5e579b11/users/59011eb1738f4ec6a0f21031a7287920/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:10.380651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278625-12b3-4cbd-8e7f-7fae7ae13104 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.383334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278625-12b3-4cbd-8e7f-7fae7ae13104 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.384483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278625-12b3-4cbd-8e7f-7fae7ae13104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.406442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae6f6-54a1-4e1e-a6a0-78a400e7de70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:10.409456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae6f6-54a1-4e1e-a6a0-78a400e7de70 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.424911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 953/1896] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:10 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:10.427351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.427351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.427351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.439045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-cc278625-12b3-4cbd-8e7f-7fae7ae13104 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:10.440338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-cc278625-12b3-4cbd-8e7f-7fae7ae13104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.484336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] MFA Rules not processed for user `59011eb1738f4ec6a0f21031a7287920`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:10.485642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.593660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 954/1897] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:10.598572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.600670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.616893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 944/1898] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:10.627159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64340e-f99b-47b5-85fc-71c922ae8676 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.627525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64340e-f99b-47b5-85fc-71c922ae8676 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.628307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64340e-f99b-47b5-85fc-71c922ae8676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.676038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9a64340e-f99b-47b5-85fc-71c922ae8676 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:10.678870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9a64340e-f99b-47b5-85fc-71c922ae8676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.709209 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 945/1899] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:10.711270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64340e-f99b-47b5-85fc-71c922ae8676 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.733803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64340e-f99b-47b5-85fc-71c922ae8676 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:10.741569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:10.742095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6d43d-b982-4ab6-bbd0-ef199e64f6bf None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:10.743934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.745586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.745872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.746768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:10.747169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:10.748625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:10.749433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.749559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.749712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.750153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.750930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:10.752983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.763719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 946/1900] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:10.769777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.782323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d33d8f-02d4-43fa-bb83-b12a9e764b49 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:10.788346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:10.789446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.790865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.791143 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.791800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:10.795622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.929825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 955/1901] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:10 2022] POST /identity/v3/projects => generated 379 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:10.934892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.957334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 947/1902] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:10 2022] POST /identity/v3/projects => generated 357 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:10.962347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.016544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfe0ec-cf5a-4944-8201-ea6618d9a57a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.068098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87184f9-06b4-46e3-8834-310ea4be29d9 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.078043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.078619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.078905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.079279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.079842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.081925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.114924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.116523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.116847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.117368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.118750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.122743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.193907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 948/1903] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:10 2022] POST /identity/v3/users => generated 279 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:11.198020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.208529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77282a-96e3-486e-ac01-abd778c987ac admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.214836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.215459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.215741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.216014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.216823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.218644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.222920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 956/1904] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:10 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:11.230258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.237902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 949/1905] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:11.238737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.249604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ed96-5eb5-43c6-a5b7-b8d9410f5eb9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.253256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c856e0-3e95-441c-9b1a-0c8b3a63105d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.261723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.262382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.262668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.262946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.263611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.267653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.270958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.271617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.271893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.272333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.272832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.279635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.292911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 957/1906] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:11.296839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 950/1907] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:11.297891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.298244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.310965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7750d9-2cf1-459b-a952-5cd035cc296d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.314344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67065def-05f2-438c-b07e-70d9e182e868 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.316773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.317673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.317956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.318239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] PATH_INFO: `/v3/projects/9b7ddbdcfea94fe3aaf285d86a1b1dae/users/439a004a1fe34d2bac1562469a660523/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.324465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce1114-197a-45d1-891b-bd7853a0bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.326529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1114-197a-45d1-891b-bd7853a0bca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.327427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1114-197a-45d1-891b-bd7853a0bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.328362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1114-197a-45d1-891b-bd7853a0bca3 admin admin] PATH_INFO: `/v3/projects/99f0044e87754976b711112fdeedb6d8/users/4f44d748272240849d6a663e9ba95321/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.368947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7ddbdcfea94fe3aaf285d86a1b1dae, user_id=439a004a1fe34d2bac1562469a660523, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.369330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce1114-197a-45d1-891b-bd7853a0bca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f0044e87754976b711112fdeedb6d8, user_id=4f44d748272240849d6a663e9ba95321, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.370852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.371167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce1114-197a-45d1-891b-bd7853a0bca3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.541705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 958/1908] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:11 2022] PUT /identity/v3/projects/99f0044e87754976b711112fdeedb6d8/users/4f44d748272240849d6a663e9ba95321/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:11.552017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.552309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.552600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.583215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] MFA Rules not processed for user `4f44d748272240849d6a663e9ba95321`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:11.584450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:11.590720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 951/1909] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:11 2022] PUT /identity/v3/projects/9b7ddbdcfea94fe3aaf285d86a1b1dae/users/439a004a1fe34d2bac1562469a660523/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:11.595860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.676208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 959/1910] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:11.678135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.681841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:11.730753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81283dd7-d3ea-4119-bc24-be7393762048 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.739090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.740034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.740638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.741241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.742172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.744956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.759908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 952/1911] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:11.760788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.772555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eb5b8-018b-42f2-afc6-d1e18b2e302e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.773443 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b0ccb-43b9-4adf-99b1-9c0d83b7c85f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:11.778698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.779484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.779771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.780049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.780705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.782667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.796900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:11.797868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:11.798173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:11.798883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] PATH_INFO: `/v3/users/d2ceaf99a6e94933951cdd29d507270b` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:11.800952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ceaf99a6e94933951cdd29d507270b)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:11.806556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:11.907884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 953/1912] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:11 2022] POST /identity/v3/projects => generated 355 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:11.908965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:11.924606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:11.995493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d38ab6-8b69-4faa-9758-d978645a7694 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.000943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.001687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.001972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.002272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] PATH_INFO: `/v3/projects/9b7ddbdcfea94fe3aaf285d86a1b1dae/users/439a004a1fe34d2bac1562469a660523/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.004606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7ddbdcfea94fe3aaf285d86a1b1dae, user_id=439a004a1fe34d2bac1562469a660523, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.008221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.023781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 954/1913] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:11 2022] PUT /identity/v3/projects/9b7ddbdcfea94fe3aaf285d86a1b1dae/users/439a004a1fe34d2bac1562469a660523/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:12.026144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:12.092804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ceaf99a6e94933951cdd29d507270b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:12.098441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b48d1-c354-4a77-b514-fe6643195d40 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.103775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f3a8d-aa1e-48b9-9db6-ef551ab7dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.104388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3a8d-aa1e-48b9-9db6-ef551ab7dc31 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.104733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3a8d-aa1e-48b9-9db6-ef551ab7dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.105005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3a8d-aa1e-48b9-9db6-ef551ab7dc31 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.105666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f3a8d-aa1e-48b9-9db6-ef551ab7dc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.106072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ceaf99a6e94933951cdd29d507270b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:12.107568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f3a8d-aa1e-48b9-9db6-ef551ab7dc31 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.113040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ceaf99a6e94933951cdd29d507270b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:12.146757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:12.186395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ceaf99a6e94933951cdd29d507270b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:12.187059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6c876801-fa69-49db-abb1-01edc7bed948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ceaf99a6e94933951cdd29d507270b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:12.193607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 960/1914] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:11 2022] DELETE /identity/v3/users/d2ceaf99a6e94933951cdd29d507270b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:12.194815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.195103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.195384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.210269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 955/1915] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:12 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:12.211651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.211948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.212230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.225356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] MFA Rules not processed for user `439a004a1fe34d2bac1562469a660523`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:12.226603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:12.232823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:12.234324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:12.296766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 956/1916] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:12.297709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:12.299091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:12.302672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 961/1917] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:12.309911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:12.311595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:12.318774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84fb30-308e-44c3-b820-fa62067d3e71 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.324145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.324827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.325160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.325432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.326136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.328091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.338785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 957/1918] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:12.339788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:12.346973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:12.388699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e57385-9abc-4ede-8512-a773a6903161 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.394815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.395835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.396299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.396751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.417942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.419969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.432563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 962/1919] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:12.433265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:12.443971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e4fbd-8475-4987-9361-d8cd9ea214d4 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.449468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.450121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.450335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.450566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] PATH_INFO: `/v3/projects/b84df8843b0a49c09b644a097296a961/users/81e1b5a7c28540ea9ad3b6bcbfc44949/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.459016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b0032-1ee4-42cc-a03f-4c6b4aee7acd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.465697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.473771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.473771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.473771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.474092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84df8843b0a49c09b644a097296a961, user_id=81e1b5a7c28540ea9ad3b6bcbfc44949, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.474092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.486204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.488128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.500688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 958/1920] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:12.605926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 963/1921] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:12 2022] PUT /identity/v3/projects/b84df8843b0a49c09b644a097296a961/users/81e1b5a7c28540ea9ad3b6bcbfc44949/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:12.609883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:12.628664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99d9e5-cd20-4e65-a4ed-6c4b0e9b70fd service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.732305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996b26b-bdfc-46ff-a616-10cc3d449ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.733507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996b26b-bdfc-46ff-a616-10cc3d449ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.733896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996b26b-bdfc-46ff-a616-10cc3d449ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.734399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996b26b-bdfc-46ff-a616-10cc3d449ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.735744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996b26b-bdfc-46ff-a616-10cc3d449ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.739051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996b26b-bdfc-46ff-a616-10cc3d449ef5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.755405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 959/1922] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:12.763809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:12.775206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d8fe-9a81-43b7-b2a2-1a9d7672546a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:12.781731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:12.782474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.782758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.783031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] PATH_INFO: `/v3/projects/b84df8843b0a49c09b644a097296a961/users/81e1b5a7c28540ea9ad3b6bcbfc44949/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.785922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84df8843b0a49c09b644a097296a961, user_id=81e1b5a7c28540ea9ad3b6bcbfc44949, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:12.793765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:12.813019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 964/1923] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:12 2022] PUT /identity/v3/projects/b84df8843b0a49c09b644a097296a961/users/81e1b5a7c28540ea9ad3b6bcbfc44949/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:12.841613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:12.842166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:12.842629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:12.888201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] MFA Rules not processed for user `81e1b5a7c28540ea9ad3b6bcbfc44949`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:12.889871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:12.972590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 960/1924] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:13.155998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:13.159125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:13.262168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ecd57-9166-475c-b2e2-6303f3bf0fff admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:13.270544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:13.271676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:13.272142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:13.272620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] PATH_INFO: `/v3/projects/3bc7a45546ec46f48180fd4593d70097` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:13.276226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc7a45546ec46f48180fd4593d70097)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:13.280919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:13.287606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:13.289866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:13.375653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1db56-aab6-4f51-b2a3-7b86edb6a075 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:13.379626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:13.380240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:13.380528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:13.380966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:13.395621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:13.395621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:13.403042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 961/1925] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:13.439468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc7a45546ec46f48180fd4593d70097', 'request_id': 'req-f7119bf8-1531-4406-a997-3e8988ad976f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:13.447818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc7a45546ec46f48180fd4593d70097', 'request_id': 'req-f7119bf8-1531-4406-a997-3e8988ad976f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:13.456176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc7a45546ec46f48180fd4593d70097', 'request_id': 'req-f7119bf8-1531-4406-a997-3e8988ad976f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:13.605688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] The token cache is being invalidate because project 3bc7a45546ec46f48180fd4593d70097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:13.606142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:13.606962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:13.608659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 965/1926] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:13 2022] DELETE /identity/v3/projects/3bc7a45546ec46f48180fd4593d70097 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:13.612822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:13.623993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a59b-241d-4f36-a02a-a3195301dd73 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:13.681647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:13.682320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:13.682608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:13.682916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] PATH_INFO: `/v3/users/755328babe9a4138b30833aa04678203` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:13.689593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=755328babe9a4138b30833aa04678203)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:13.690992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:13.691861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:13.693793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:13.768280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119bf8-1531-4406-a997-3e8988ad976f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:13.774789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:13.775915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:13.776461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:13.777047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:13.779781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:13.863842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:13.863842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:13.875063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 966/1927] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:13.988908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755328babe9a4138b30833aa04678203'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:14.001144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755328babe9a4138b30833aa04678203'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:14.001832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755328babe9a4138b30833aa04678203'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:14.008644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755328babe9a4138b30833aa04678203'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:14.141318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755328babe9a4138b30833aa04678203'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:14.141657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:14.153835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:14.155269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:14.155543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 962/1928] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:13 2022] DELETE /identity/v3/users/755328babe9a4138b30833aa04678203 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:14.279409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3ac9c-0b23-4855-b350-680733c5da72 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:14.363244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439a004a1fe34d2bac1562469a660523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7ddbdcfea94fe3aaf285d86a1b1dae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:14.364287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:14.364793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:14.367146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:14.368937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:14.369591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:14.372926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:14.388456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:14.400552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 967/1929] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:31:14.406052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:14.408035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:14.441622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1543b-83ea-49ca-b99e-48d8908b6e30 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:14.451339 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439a004a1fe34d2bac1562469a660523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7ddbdcfea94fe3aaf285d86a1b1dae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:14.452135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:14.452502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:14.452822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:14.454273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:14.456414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:14.609310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 963/1930] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:14 2022] POST /identity/v3/projects => generated 354 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:14.613188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:14.630020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a5386-132d-4adc-ae26-dcddfe3476a1 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:14.699194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439a004a1fe34d2bac1562469a660523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7ddbdcfea94fe3aaf285d86a1b1dae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:14.699806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:14.700093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:14.700377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:14.701033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:14.701373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:14.703016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:14.716105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 968/1931] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:14.760021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:14.771153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec44e-c1e3-49cf-b56f-45fb12ee83d2 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:14.776460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439a004a1fe34d2bac1562469a660523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7ddbdcfea94fe3aaf285d86a1b1dae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:14.777122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:14.777407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:14.777682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] PATH_INFO: `/v3/projects/2e5b57db5d3442cb8032aaa7c4adc0a3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:14.778807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e5b57db5d3442cb8032aaa7c4adc0a3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:14.780711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:14.886856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:14.887849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:14.960027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738caf1c-b1e4-48cd-9f8b-776e18bcb59a tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:14.966670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:14.967450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:14.967721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:14.968001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] PATH_INFO: `/v3/projects/73ed07b78dcc48298b69dcc22defdc51` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:14.969285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ed07b78dcc48298b69dcc22defdc51)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:14.971276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:14.987953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5b57db5d3442cb8032aaa7c4adc0a3', 'request_id': 'req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.085661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5b57db5d3442cb8032aaa7c4adc0a3', 'request_id': 'req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.096156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5b57db5d3442cb8032aaa7c4adc0a3', 'request_id': 'req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.109786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] The token cache is being invalidate because project 2e5b57db5d3442cb8032aaa7c4adc0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:15.110125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.110906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c93b5b1c-77fb-460b-bf26-b2a5a77b59f7 tempest-VolumeQuotaClassesTest-163137321 tempest-VolumeQuotaClassesTest-163137321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.112671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 964/1932] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:14 2022] DELETE /identity/v3/projects/2e5b57db5d3442cb8032aaa7c4adc0a3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:15.151185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ed07b78dcc48298b69dcc22defdc51', 'request_id': 'req-e503478b-268d-491a-8bc5-414e34573881'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.159969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ed07b78dcc48298b69dcc22defdc51', 'request_id': 'req-e503478b-268d-491a-8bc5-414e34573881'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.170546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ed07b78dcc48298b69dcc22defdc51', 'request_id': 'req-e503478b-268d-491a-8bc5-414e34573881'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.248758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] The token cache is being invalidate because project 73ed07b78dcc48298b69dcc22defdc51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:15.249047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.249722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-e503478b-268d-491a-8bc5-414e34573881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:15.251236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 969/1933] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:14 2022] DELETE /identity/v3/projects/73ed07b78dcc48298b69dcc22defdc51 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:15.256340 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3057-6aac-49af-ba07-bf23afa8b814 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.256629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3057-6aac-49af-ba07-bf23afa8b814 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.256911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3057-6aac-49af-ba07-bf23afa8b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.282438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-486c3057-6aac-49af-ba07-bf23afa8b814 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:15.283694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-486c3057-6aac-49af-ba07-bf23afa8b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:15.369144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 965/1934] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:15.376941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e18b84-05d0-4222-9220-004600c766f9 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.377356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e18b84-05d0-4222-9220-004600c766f9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.377728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e18b84-05d0-4222-9220-004600c766f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.419352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-65e18b84-05d0-4222-9220-004600c766f9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:15.425094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-65e18b84-05d0-4222-9220-004600c766f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:15.450277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 970/1935] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:15.451905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3057-6aac-49af-ba07-bf23afa8b814 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:15.463943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3057-6aac-49af-ba07-bf23afa8b814 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:15.469316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:15.470137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.470490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.479085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.479711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:15.480055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:15.482237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:15.495721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 966/1936] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:15.500697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e18b84-05d0-4222-9220-004600c766f9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:15.516848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e18b84-05d0-4222-9220-004600c766f9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:15.522663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:15.522663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.523104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.523788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.525105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:15.527431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:15.655110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 971/1937] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:15 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:15.659926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:15.672220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63492bf-6585-4481-86f9-118bc0182e0f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:15.784428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:15.785192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.785774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.786197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.787004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:15.789348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:15.930920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 967/1938] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:15 2022] POST /identity/v3/users => generated 301 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:15.936358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:15.948861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85eb28-47d6-4fe9-9c1e-c02dc03e10e1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:15.956403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:15.958208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.962765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.962765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.962765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:15.962765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:15.987883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 972/1939] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:15.994003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:16.012536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795e5b2-8c20-4692-8d39-196623342ab2 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:16.019808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f3797-a242-464b-a05a-44b50be9dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:16.020777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3797-a242-464b-a05a-44b50be9dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.021942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3797-a242-464b-a05a-44b50be9dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.022332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3797-a242-464b-a05a-44b50be9dc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.023188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f3797-a242-464b-a05a-44b50be9dc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:16.025032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f3797-a242-464b-a05a-44b50be9dc36 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:16.045982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 968/1940] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:16.048955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:16.061129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5b2c9-6799-4f01-b128-182f0fda45dd admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:16.069527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:16.071153 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.071541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.072360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] PATH_INFO: `/v3/projects/47f0840c838c45a18c32b628313b452e/users/2660c8a74a18425e85c2560697f0e5f5/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.101360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f0840c838c45a18c32b628313b452e, user_id=2660c8a74a18425e85c2560697f0e5f5, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:16.108547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:16.241719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 973/1941] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:16 2022] PUT /identity/v3/projects/47f0840c838c45a18c32b628313b452e/users/2660c8a74a18425e85c2560697f0e5f5/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:16.252900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e224-d2f3-437c-b1d1-4c4ce2795c6f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.253215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e224-d2f3-437c-b1d1-4c4ce2795c6f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.253494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e224-d2f3-437c-b1d1-4c4ce2795c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.299826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7098e224-d2f3-437c-b1d1-4c4ce2795c6f None None] MFA Rules not processed for user `2660c8a74a18425e85c2560697f0e5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:16.299826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7098e224-d2f3-437c-b1d1-4c4ce2795c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:16.338460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:16.343657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:16.482309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 969/1942] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:16 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:16.483275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098e224-d2f3-437c-b1d1-4c4ce2795c6f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:16.488774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ade105-85b9-407c-91a5-60cc69fd9e04 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:16.495265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098e224-d2f3-437c-b1d1-4c4ce2795c6f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:16.495546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:16.496122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.496505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.496665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] PATH_INFO: `/v3/users/59011eb1738f4ec6a0f21031a7287920` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.498138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59011eb1738f4ec6a0f21031a7287920)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:16.500584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:16.500991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:16.501683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.501960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.502224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.503068 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:16.505021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:16.564248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:16.647251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 970/1943] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:16 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:16.655455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:16.770710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476f56-5036-4ea5-9952-cc1ead5054dc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:16.782338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:16.783296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.783847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.784397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.785368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:16.788739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59011eb1738f4ec6a0f21031a7287920'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:16.790040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:16.825578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59011eb1738f4ec6a0f21031a7287920'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:16.847881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59011eb1738f4ec6a0f21031a7287920'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:16.941735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59011eb1738f4ec6a0f21031a7287920'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:16.942409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f3e56a84-b005-46d4-a56b-d0ca58411c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59011eb1738f4ec6a0f21031a7287920'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:16.953228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 971/1944] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:16 2022] POST /identity/v3/users => generated 306 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:16.959722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 974/1945] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:16 2022] DELETE /identity/v3/users/59011eb1738f4ec6a0f21031a7287920 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:16.964625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1de5-3928-43f6-a6c7-dd69f4f22d24 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.965731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:16.965906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1de5-3928-43f6-a6c7-dd69f4f22d24 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.965906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1de5-3928-43f6-a6c7-dd69f4f22d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.967250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:16.969432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:16.988883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30817-6aa8-42cc-bf2d-37168718d3a6 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:17.038954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3e6a1de5-3928-43f6-a6c7-dd69f4f22d24 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:17.040239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3e6a1de5-3928-43f6-a6c7-dd69f4f22d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:17.114565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:17.115735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:17.116588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:17.117220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:17.119766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:17.125899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:17.156102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 975/1946] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:17.159145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 972/1947] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:17.165000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1de5-3928-43f6-a6c7-dd69f4f22d24 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:17.178286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1de5-3928-43f6-a6c7-dd69f4f22d24 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:17.181706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:17.183500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:17.221974 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:17.223186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:17.223678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:17.224175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] PATH_INFO: `/v3/projects/92e50b2e7dfa4173a0240aba5dd2a2fd/users/a19a2898da0442d08b0c3b4599430054/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:17.284175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e50b2e7dfa4173a0240aba5dd2a2fd, user_id=a19a2898da0442d08b0c3b4599430054, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:17.327773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:17.328037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f6d9a-a82d-49df-b3c9-a510aaca0ebd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:17.336253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:17.339685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:17.340102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:17.346736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:17.374214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:17.376738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:17.398389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 973/1948] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:17.480555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 976/1949] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:17 2022] PUT /identity/v3/projects/92e50b2e7dfa4173a0240aba5dd2a2fd/users/a19a2898da0442d08b0c3b4599430054/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:17.486077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:17.523103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af227f23-886f-4266-bcdc-a7a3d7083e16 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:17.623386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:17.665748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4651dc9-ff60-4beb-ad75-b491b8f0982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:17.666392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4651dc9-ff60-4beb-ad75-b491b8f0982c admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:17.666705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4651dc9-ff60-4beb-ad75-b491b8f0982c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:17.666956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4651dc9-ff60-4beb-ad75-b491b8f0982c admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:17.667597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4651dc9-ff60-4beb-ad75-b491b8f0982c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:17.669277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4651dc9-ff60-4beb-ad75-b491b8f0982c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:17.702216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 974/1950] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:17.703483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:17.718244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847818-27bf-4dc5-bc33-4be81996302b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:17.732184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:17.733741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:17.734257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:17.734820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] PATH_INFO: `/v3/projects/92e50b2e7dfa4173a0240aba5dd2a2fd/users/a19a2898da0442d08b0c3b4599430054/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:17.738429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e50b2e7dfa4173a0240aba5dd2a2fd, user_id=a19a2898da0442d08b0c3b4599430054, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:17.744230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:17.767281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 977/1951] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:17 2022] PUT /identity/v3/projects/92e50b2e7dfa4173a0240aba5dd2a2fd/users/a19a2898da0442d08b0c3b4599430054/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:17.779775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:17.779958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:17.780238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:17.851043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] MFA Rules not processed for user `a19a2898da0442d08b0c3b4599430054`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:17.851043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:17.989938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 975/1952] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:18.001619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:18.006317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:18.143805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a10d4-cb61-463b-9ae9-f588e2a3c7c8 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:18.154631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:18.172425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:18.173894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:18.173894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:18.218774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:18.220619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:18.243144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 978/1953] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:18.307377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:18.590426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:18.594520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:18.708702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:18.738234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe5de4-c642-40f9-b82c-c4a9a4a29c9a service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:18.747905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:18.748762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:18.749519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:18.750117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:18.752817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:18.808462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b8cf6-8a58-4dea-8b09-85e6c74a87fb None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:18.826972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:18.827636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:18.827913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:18.828182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] PATH_INFO: `/v3/projects/de5332d9995d47c3984be1fa5e579b11` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:18.832577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5332d9995d47c3984be1fa5e579b11)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:18.834690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:18.836463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:18.849054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:18.868251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 979/1954] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:18 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:19.090928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5332d9995d47c3984be1fa5e579b11', 'request_id': 'req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.188217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:19.189389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5332d9995d47c3984be1fa5e579b11', 'request_id': 'req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.197848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5332d9995d47c3984be1fa5e579b11', 'request_id': 'req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.212366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] The token cache is being invalidate because project de5332d9995d47c3984be1fa5e579b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:19.212977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.213821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.216059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 976/1955] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:18 2022] DELETE /identity/v3/projects/de5332d9995d47c3984be1fa5e579b11 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:19.220847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:19.236433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace25f4f-b52c-41a0-889f-07c6e2fb11e2 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:19.338839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:19.341430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:19.341430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:19.345206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] PATH_INFO: `/v3/users/439a004a1fe34d2bac1562469a660523` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:19.346999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439a004a1fe34d2bac1562469a660523)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:19.350085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:19.654910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439a004a1fe34d2bac1562469a660523'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.674189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439a004a1fe34d2bac1562469a660523'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.678248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:19.685151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439a004a1fe34d2bac1562469a660523'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.769285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439a004a1fe34d2bac1562469a660523'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.769985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439a004a1fe34d2bac1562469a660523'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:19.786981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:19.789988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:19.799467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 980/1956] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:19 2022] DELETE /identity/v3/users/439a004a1fe34d2bac1562469a660523 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:19.825205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2bd7-08c7-4085-abb8-550ccfea3e1d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:19.978780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:19.981252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:19.981924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:19.985189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] PATH_INFO: `/v3/users/2d937c7f06fd42b1a4fd14e57d4ac6b0` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:19.985189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d937c7f06fd42b1a4fd14e57d4ac6b0)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:19.986579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:20.396158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d937c7f06fd42b1a4fd14e57d4ac6b0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.423191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d937c7f06fd42b1a4fd14e57d4ac6b0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.424484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d937c7f06fd42b1a4fd14e57d4ac6b0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.440082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d937c7f06fd42b1a4fd14e57d4ac6b0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.523606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9a172abe-7302-41e2-9cff-30052ffde618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d937c7f06fd42b1a4fd14e57d4ac6b0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.533046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:20.536140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:20.545188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 977/1957] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:19 2022] DELETE /identity/v3/users/2d937c7f06fd42b1a4fd14e57d4ac6b0 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:20.550725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:20.551022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:20.551386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:20.553637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db610c-bb51-424e-a88c-91d30eb4d238 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:20.577992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:20.579228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:20.677368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:20.678094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:20.678392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:20.678655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] PATH_INFO: `/v3/projects/9b7ddbdcfea94fe3aaf285d86a1b1dae` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:20.680887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7ddbdcfea94fe3aaf285d86a1b1dae)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:20.683493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:20.746378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 978/1958] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:20.764766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:20.766491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:20.869663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6d68a-abf1-4452-a7d8-d7537e01b8b6 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:20.881505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7ddbdcfea94fe3aaf285d86a1b1dae', 'request_id': 'req-7eac3d06-3550-488f-b57e-7cc9e37e867c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.888168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7ddbdcfea94fe3aaf285d86a1b1dae', 'request_id': 'req-7eac3d06-3550-488f-b57e-7cc9e37e867c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.910908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7ddbdcfea94fe3aaf285d86a1b1dae', 'request_id': 'req-7eac3d06-3550-488f-b57e-7cc9e37e867c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:20.950863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921a6f-a115-4757-96bd-3a07423c4ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:20.951632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921a6f-a115-4757-96bd-3a07423c4ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:20.951994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921a6f-a115-4757-96bd-3a07423c4ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:20.952532 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921a6f-a115-4757-96bd-3a07423c4ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.047561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921a6f-a115-4757-96bd-3a07423c4ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.049137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921a6f-a115-4757-96bd-3a07423c4ed4 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:21.061407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 979/1959] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:21.090274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:21.104335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] The token cache is being invalidate because project 9b7ddbdcfea94fe3aaf285d86a1b1dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:21.104335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:21.110502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7eac3d06-3550-488f-b57e-7cc9e37e867c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:21.113359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 981/1960] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:20 2022] DELETE /identity/v3/projects/9b7ddbdcfea94fe3aaf285d86a1b1dae => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:21.121047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3a90-facd-4aa9-a4e3-d2a9a3e5ceec None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.121380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3a90-facd-4aa9-a4e3-d2a9a3e5ceec None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.121892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3a90-facd-4aa9-a4e3-d2a9a3e5ceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.149725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b7aa3a90-facd-4aa9-a4e3-d2a9a3e5ceec None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:21.151658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b7aa3a90-facd-4aa9-a4e3-d2a9a3e5ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:21.164395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 980/1961] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:21.173284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986986f-80da-4e90-ac16-844f7e3c4a49 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.173559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986986f-80da-4e90-ac16-844f7e3c4a49 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.173858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986986f-80da-4e90-ac16-844f7e3c4a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.232143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1986986f-80da-4e90-ac16-844f7e3c4a49 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:21.234298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1986986f-80da-4e90-ac16-844f7e3c4a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:21.264061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 982/1962] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:21.268305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3a90-facd-4aa9-a4e3-d2a9a3e5ceec None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:21.287049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3a90-facd-4aa9-a4e3-d2a9a3e5ceec None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:21.296119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:21.297005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.297564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.297916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.300009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:21.300009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.308304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:21.323514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 981/1963] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:21.327933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986986f-80da-4e90-ac16-844f7e3c4a49 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:21.347594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986986f-80da-4e90-ac16-844f7e3c4a49 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:21.368098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:21.368757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.369304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.369578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.370233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.373275 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:21.590035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 983/1964] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:21 2022] POST /identity/v3/projects => generated 393 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:21.596919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:21.609551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675063d3-0d67-4fcc-bb6f-7ab4a3f2d4c0 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:21.703514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:21.704007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.704303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.704602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.705359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.707314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:21.760543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:21.762411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:21.779715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef685-9c9d-4190-bcaf-09c71cab4e4c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:21.785385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:21.786389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.786763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.789032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] PATH_INFO: `/v3/projects/da20f756ba0e46b2831038320a2ddb5a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.790599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da20f756ba0e46b2831038320a2ddb5a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.792663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:21.795588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 982/1965] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:21 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:21.800356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:21.815477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221496-a3a2-4c7b-a8c4-d9316e14f287 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:21.820587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:21.821760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.822040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.822314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.822965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.824600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:21.836165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 983/1966] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:21.840676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:21.850738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fbacc-2d10-4ea3-af1b-37a7ffff87ce admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:21.856127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:21.858624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.858624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.858624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.858624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.859577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:21.871112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 984/1967] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:21.875435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:21.887239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd83561-5a4a-4191-a9e1-2a3a406246de admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:21.892256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92534f90-cf6e-4d56-aa39-59b6c2afda26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:21.892966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92534f90-cf6e-4d56-aa39-59b6c2afda26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:21.893297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92534f90-cf6e-4d56-aa39-59b6c2afda26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:21.893543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92534f90-cf6e-4d56-aa39-59b6c2afda26 admin admin] PATH_INFO: `/v3/projects/d49119a2bdc74a68a0e0297136aa90f9/users/9d0c8943d82c4a6dac6e45084b026a96/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:21.909008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92534f90-cf6e-4d56-aa39-59b6c2afda26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49119a2bdc74a68a0e0297136aa90f9, user_id=9d0c8943d82c4a6dac6e45084b026a96, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:21.911748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92534f90-cf6e-4d56-aa39-59b6c2afda26 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:22.034373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 985/1968] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:21 2022] PUT /identity/v3/projects/d49119a2bdc74a68a0e0297136aa90f9/users/9d0c8943d82c4a6dac6e45084b026a96/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:22.046599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da20f756ba0e46b2831038320a2ddb5a', 'request_id': 'req-02f14dfa-b061-4478-8c55-3208cd3a0557'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.053253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da20f756ba0e46b2831038320a2ddb5a', 'request_id': 'req-02f14dfa-b061-4478-8c55-3208cd3a0557'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.059131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:22.060165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:22.060807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:22.062816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da20f756ba0e46b2831038320a2ddb5a', 'request_id': 'req-02f14dfa-b061-4478-8c55-3208cd3a0557'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.128955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] MFA Rules not processed for user `9d0c8943d82c4a6dac6e45084b026a96`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:22.130028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:22.216900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] The token cache is being invalidate because project da20f756ba0e46b2831038320a2ddb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:22.217596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.218567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.220381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 984/1969] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:21 2022] DELETE /identity/v3/projects/da20f756ba0e46b2831038320a2ddb5a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:22.224893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:22.231303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:22.295909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 986/1970] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:22.300409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:22.301930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:22.363055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14dfa-b061-4478-8c55-3208cd3a0557 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:22.368539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:22.369374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:22.369726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:22.370070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] PATH_INFO: `/v3/users/c53eab7d5c8b43918f5078ad381083eb` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:22.371383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53eab7d5c8b43918f5078ad381083eb)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:22.374629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:22.409841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0371cca-5280-4400-b191-72da3ed77f4a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:22.415961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:22.416943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:22.417262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:22.417538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:22.418203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:22.420172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:22.521985 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 987/1971] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:22 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:22.528317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:22.603533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afd974-f428-4a23-a789-8c36ba999b28 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:22.608514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:22.609186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:22.609498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:22.609793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:22.610473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:22.612475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:22.651336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53eab7d5c8b43918f5078ad381083eb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.667161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53eab7d5c8b43918f5078ad381083eb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.675830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53eab7d5c8b43918f5078ad381083eb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.843079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53eab7d5c8b43918f5078ad381083eb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.844250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53eab7d5c8b43918f5078ad381083eb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:22.855132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 988/1972] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:22 2022] POST /identity/v3/users => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:22.858865 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 985/1973] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:22 2022] DELETE /identity/v3/users/c53eab7d5c8b43918f5078ad381083eb => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:22.859184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:22.861923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:22.880761 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2650e-32a5-4c0c-b99e-136b10cc51c6 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:22.969557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:22.970211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:22.970496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:22.970773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:22.971439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:22.973191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:22.984502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 989/1974] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:22.990943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:23.004762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d1c1b-022b-48be-abbd-724afb2bd819 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:23.014530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:23.024782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.024782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.024782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] PATH_INFO: `/v3/projects/34fdfa5e696045b49d2bfa40e5bb240f/users/775a193798744067bd8222accc99933f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.045474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fdfa5e696045b49d2bfa40e5bb240f, user_id=775a193798744067bd8222accc99933f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:23.049357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:23.058921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:23.294555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 986/1975] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:22 2022] PUT /identity/v3/projects/34fdfa5e696045b49d2bfa40e5bb240f/users/775a193798744067bd8222accc99933f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:23.298490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:23.311594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e8b9-58d1-4cc6-8a63-37ba5a01c148 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:23.421442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428313d8-9712-42cb-bbd4-3a67c709f00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:23.422098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428313d8-9712-42cb-bbd4-3a67c709f00d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.422517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428313d8-9712-42cb-bbd4-3a67c709f00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.422962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428313d8-9712-42cb-bbd4-3a67c709f00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.423632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428313d8-9712-42cb-bbd4-3a67c709f00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:23.425619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428313d8-9712-42cb-bbd4-3a67c709f00d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:23.445266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 990/1976] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:23.445446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:23.457192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aedd4-c01c-4dab-82d3-8832fc7bfc68 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:23.463218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:23.463888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.464170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.464447 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] PATH_INFO: `/v3/projects/34fdfa5e696045b49d2bfa40e5bb240f/users/775a193798744067bd8222accc99933f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.466803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fdfa5e696045b49d2bfa40e5bb240f, user_id=775a193798744067bd8222accc99933f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:23.469522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:23.480625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 987/1977] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:23 2022] PUT /identity/v3/projects/34fdfa5e696045b49d2bfa40e5bb240f/users/775a193798744067bd8222accc99933f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:23.494415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.494699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.494976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.510363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:23.513222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:23.527585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] MFA Rules not processed for user `775a193798744067bd8222accc99933f`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:23.528959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:23.595181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4bcab-c649-4011-89f4-b17d75159f3a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:23.600150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:23.600811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.601117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.601397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] PATH_INFO: `/v3/projects/83d88f98cc9d438cb5ad50f83d7eb0c4` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.602633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d88f98cc9d438cb5ad50f83d7eb0c4)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:23.604612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:23.606212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 991/1978] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:23.617476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:23.618915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:23.682543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ac6-bb21-414e-b4f2-ce024a6e1226 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:23.686577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:23.687286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.687635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.687961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.699129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:23.700679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:23.713769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 992/1979] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:23.768079 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:23.769530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:23.781650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b0856-60bc-4c6c-bee4-15c346e33bb6 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:23.785354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4dd9-db62-44cb-adbd-6d409d9654d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:23.785950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4dd9-db62-44cb-adbd-6d409d9654d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.786226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4dd9-db62-44cb-adbd-6d409d9654d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.786492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4dd9-db62-44cb-adbd-6d409d9654d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.788733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b0cf4dd9-db62-44cb-adbd-6d409d9654d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:23.859278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4dd9-db62-44cb-adbd-6d409d9654d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:23.860710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4dd9-db62-44cb-adbd-6d409d9654d1 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:23.870073 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 993/1980] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:24.119346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d88f98cc9d438cb5ad50f83d7eb0c4', 'request_id': 'req-4635f8bd-7829-4cd5-92b4-16e007c76c81'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:24.119346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d88f98cc9d438cb5ad50f83d7eb0c4', 'request_id': 'req-4635f8bd-7829-4cd5-92b4-16e007c76c81'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:24.125056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d88f98cc9d438cb5ad50f83d7eb0c4', 'request_id': 'req-4635f8bd-7829-4cd5-92b4-16e007c76c81'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:24.953951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] The token cache is being invalidate because project 83d88f98cc9d438cb5ad50f83d7eb0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:24.963198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:24.963198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4635f8bd-7829-4cd5-92b4-16e007c76c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:24.963198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 988/1981] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:23 2022] DELETE /identity/v3/projects/83d88f98cc9d438cb5ad50f83d7eb0c4 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:24.967952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e91edf-0f42-4515-9062-280014ee34b8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:24.968636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e91edf-0f42-4515-9062-280014ee34b8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:24.968636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e91edf-0f42-4515-9062-280014ee34b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:24.990689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-37e91edf-0f42-4515-9062-280014ee34b8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:24.991932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-37e91edf-0f42-4515-9062-280014ee34b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:25.061473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 994/1982] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:25.070860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124128fa-6d76-4d7f-836a-1c3ecd128de7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.071238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124128fa-6d76-4d7f-836a-1c3ecd128de7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.071737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124128fa-6d76-4d7f-836a-1c3ecd128de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.091998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-124128fa-6d76-4d7f-836a-1c3ecd128de7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:25.093238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-124128fa-6d76-4d7f-836a-1c3ecd128de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:25.101439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 989/1983] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:25.106613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e91edf-0f42-4515-9062-280014ee34b8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:25.116820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e91edf-0f42-4515-9062-280014ee34b8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:25.126524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:25.127512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.127960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.128334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.129568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:25.130028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:25.133012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:25.147927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 995/1984] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:25.154276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124128fa-6d76-4d7f-836a-1c3ecd128de7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:25.166657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124128fa-6d76-4d7f-836a-1c3ecd128de7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:25.179744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:25.181351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.181935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.182545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.183278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:25.185259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:25.290308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:25.301055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 990/1985] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:25 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:25.302169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:25.313005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b55e1-ce87-482b-ae20-37965f371e79 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:25.376901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:25.377485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.377766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.378040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.378689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:25.380819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:25.501672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 996/1986] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:25 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:25.505964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:25.516694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236670d-5f46-481e-924d-71508ad380d2 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:25.524279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:25.525023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.525485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.527032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.527032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:25.528222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:25.548844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 991/1987] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:25.549738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:25.583975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e95cc2-6373-4925-bcb0-7d5bc6635176 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:25.596164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bee99-3e7c-491d-9083-2971df21b743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:25.596512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bee99-3e7c-491d-9083-2971df21b743 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.596892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bee99-3e7c-491d-9083-2971df21b743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.597258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bee99-3e7c-491d-9083-2971df21b743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.598082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bee99-3e7c-491d-9083-2971df21b743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:25.602435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bee99-3e7c-491d-9083-2971df21b743 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:25.627634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 997/1988] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:25.628218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:25.638421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daed64a-2b61-42e2-a46b-ce6fab361682 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:25.645340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:25.646533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.647023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.647299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] PATH_INFO: `/v3/projects/42de41c616664bb2b0c6cb211333ca36/users/af2e285760c04c8d8ae527babc578ed1/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.671361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42de41c616664bb2b0c6cb211333ca36, user_id=af2e285760c04c8d8ae527babc578ed1, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:25.674088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:25.786939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 992/1989] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:25 2022] PUT /identity/v3/projects/42de41c616664bb2b0c6cb211333ca36/users/af2e285760c04c8d8ae527babc578ed1/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:25.797570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d8a27-a4af-4919-9b03-72f563afe0d0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:25.797860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d8a27-a4af-4919-9b03-72f563afe0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:25.798964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d8a27-a4af-4919-9b03-72f563afe0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:25.831848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-460d8a27-a4af-4919-9b03-72f563afe0d0 None None] MFA Rules not processed for user `af2e285760c04c8d8ae527babc578ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:25.833413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-460d8a27-a4af-4919-9b03-72f563afe0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:25.921111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 998/1990] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:25.922456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:25.995494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26186eb9-a2a1-4b21-adfa-15aa8fd16e81 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:26.003984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:26.004370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:26.004653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:26.004930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:26.005628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:26.007535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:26.184111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 993/1991] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:25 2022] POST /identity/v3/projects => generated 377 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:26.188092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d8a27-a4af-4919-9b03-72f563afe0d0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:26.200027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d8a27-a4af-4919-9b03-72f563afe0d0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:26.262368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:26.263001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:26.263322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:26.263540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:26.264182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:26.266131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:26.454475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 999/1992] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:26 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:26.458510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:26.469254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066283d1-b9a3-411e-b49b-5ac80ad59c60 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:26.474307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:26.474969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:26.475349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:26.475521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:26.476164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:26.478306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:26.489225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 994/1993] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:26.493987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:26.504657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9ab6-be0c-4be1-bcba-c46a71232263 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:26.511572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebae37-310c-4fa0-be63-e05e59c07b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:26.511572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebae37-310c-4fa0-be63-e05e59c07b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:26.511572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebae37-310c-4fa0-be63-e05e59c07b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:26.511978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebae37-310c-4fa0-be63-e05e59c07b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:26.512494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebae37-310c-4fa0-be63-e05e59c07b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:26.514199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebae37-310c-4fa0-be63-e05e59c07b30 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:26.530099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1000/1994] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:26.531196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:26.543741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3be3a-73b6-4546-9a35-cedc2a3c991a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:26.548636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:26.549334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:26.549616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:26.549918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] PATH_INFO: `/v3/projects/fe0f3db1fec54954b5226bb61a7338cc/users/b35cd5563d5b412ea5be28063d39a60d/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:26.567267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0f3db1fec54954b5226bb61a7338cc, user_id=b35cd5563d5b412ea5be28063d39a60d, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:26.570227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:26.662021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 995/1995] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:26 2022] PUT /identity/v3/projects/fe0f3db1fec54954b5226bb61a7338cc/users/b35cd5563d5b412ea5be28063d39a60d/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:26.666872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12004478-6047-4235-8a55-798e5d6c30ba None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:26.667139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12004478-6047-4235-8a55-798e5d6c30ba None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:26.667414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12004478-6047-4235-8a55-798e5d6c30ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:26.708064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-12004478-6047-4235-8a55-798e5d6c30ba None None] MFA Rules not processed for user `b35cd5563d5b412ea5be28063d39a60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:26.709663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-12004478-6047-4235-8a55-798e5d6c30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:26.792911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1001/1996] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:26.801130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:26.878863 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e60ef-f2da-4519-8bef-6b7d4ac6bbfd admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:26.884792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:26.885466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:26.885757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:26.886043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:26.886814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:26.888880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:26.892994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:26.977507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 996/1997] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:26 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:26.978411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12004478-6047-4235-8a55-798e5d6c30ba None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:26.990862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12004478-6047-4235-8a55-798e5d6c30ba None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.064188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.064813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.065119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.065468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.070069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:27.072609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:27.210146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1002/1998] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:26 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:27.212816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:27.224839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cf98f-8740-4c0b-bb81-6617b135a046 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.229938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.230470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.230947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.231364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.232023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:27.233699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:27.246957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 997/1999] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:27.251119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:27.262246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3013-2ef8-43f9-88fb-c711320d950d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.267297 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.279113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.279113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.279113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] PATH_INFO: `/v3/projects/c81145eead1b4faea2991f272a2d906a/users/a665fa31ee514314b0f957c7dccf9399/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.286949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81145eead1b4faea2991f272a2d906a, user_id=a665fa31ee514314b0f957c7dccf9399, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:27.289688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:27.398311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1003/2000] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:27 2022] PUT /identity/v3/projects/c81145eead1b4faea2991f272a2d906a/users/a665fa31ee514314b0f957c7dccf9399/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:27.405147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:27.415965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3559-f80b-4497-8f55-607b10481172 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.474280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927c42b-ae39-4746-b2bb-de7ea45e0d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.474902 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c42b-ae39-4746-b2bb-de7ea45e0d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.475188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c42b-ae39-4746-b2bb-de7ea45e0d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.475496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c42b-ae39-4746-b2bb-de7ea45e0d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.476327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927c42b-ae39-4746-b2bb-de7ea45e0d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:27.477945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927c42b-ae39-4746-b2bb-de7ea45e0d30 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:27.488097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 998/2001] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:27.492384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:27.504171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf1fd-2a86-4bf8-8912-8f8a293465d4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.511303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.511303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.511615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.511767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] PATH_INFO: `/v3/projects/c81145eead1b4faea2991f272a2d906a/users/a665fa31ee514314b0f957c7dccf9399/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.514022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81145eead1b4faea2991f272a2d906a, user_id=a665fa31ee514314b0f957c7dccf9399, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:27.516776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:27.528733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1004/2002] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:27 2022] PUT /identity/v3/projects/c81145eead1b4faea2991f272a2d906a/users/a665fa31ee514314b0f957c7dccf9399/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:27.545867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.545867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.545867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.576209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] MFA Rules not processed for user `a665fa31ee514314b0f957c7dccf9399`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:27.577536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:27.660834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 999/2003] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:27.672486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:27.674280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:27.736067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8123c-9403-4a42-a39e-cc9cdddf6cf6 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.739967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.740516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.740799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.741087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.750895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:27.752313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:27.763310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1005/2004] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:27.917967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:27.926434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:27.941476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1279-dc0e-4289-b162-11620748f182 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.946147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4c325-1859-4c4a-a8d3-b7ab12cd9cac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.946750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c325-1859-4c4a-a8d3-b7ab12cd9cac service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.947023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c325-1859-4c4a-a8d3-b7ab12cd9cac service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.947475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c325-1859-4c4a-a8d3-b7ab12cd9cac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:28.005316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:28.010102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4c325-1859-4c4a-a8d3-b7ab12cd9cac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:28.011536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4c325-1859-4c4a-a8d3-b7ab12cd9cac service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:28.021234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1000/2005] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:28.736657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:28.738163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:28.820449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7c60-c0f2-4bc9-a35c-2deddbf19f7b service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:28.825367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:28.826092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:28.826275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:28.826547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] PATH_INFO: `/v3/users/2660c8a74a18425e85c2560697f0e5f5` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:28.827985 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2660c8a74a18425e85c2560697f0e5f5)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:28.830145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:29.093616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2660c8a74a18425e85c2560697f0e5f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:29.107548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2660c8a74a18425e85c2560697f0e5f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:29.108355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2660c8a74a18425e85c2560697f0e5f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:29.116509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2660c8a74a18425e85c2560697f0e5f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:29.274814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2660c8a74a18425e85c2560697f0e5f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:29.290480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1006/2006] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:28 2022] DELETE /identity/v3/users/2660c8a74a18425e85c2560697f0e5f5 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:29.291901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:29.292361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:29.292478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:29.344830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:29.346114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:29.471728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1001/2007] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:29.483103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:29.484567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:29.563779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284c12e-b59b-4938-937f-f683017e7ee5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:29.568085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:29.568774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:29.569247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:29.569596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:29.585548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:29.588474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:29.602956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1007/2008] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:29.755839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:30.058098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:30.316998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:30.318694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:30.348051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cb0b8-9677-4f4d-9e32-c8eef2c13686 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:30.355504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:30.356372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:30.357091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:30.363438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] PATH_INFO: `/v3/projects/47f0840c838c45a18c32b628313b452e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:30.363438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f0840c838c45a18c32b628313b452e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:30.363438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:30.570166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f0840c838c45a18c32b628313b452e', 'request_id': 'req-ab077426-ab46-454c-9494-ad357e558065'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:30.570166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f0840c838c45a18c32b628313b452e', 'request_id': 'req-ab077426-ab46-454c-9494-ad357e558065'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:30.570166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f0840c838c45a18c32b628313b452e', 'request_id': 'req-ab077426-ab46-454c-9494-ad357e558065'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:30.725403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] The token cache is being invalidate because project 47f0840c838c45a18c32b628313b452e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:30.726098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:30.726787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:30.728790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1002/2009] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:30 2022] DELETE /identity/v3/projects/47f0840c838c45a18c32b628313b452e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:30.732576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:30.750121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e28323-3c80-4702-9bdb-c740658f29b1 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:30.847417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:30.851722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:30.851722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:30.851722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] PATH_INFO: `/v3/users/a19a2898da0442d08b0c3b4599430054` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:30.851722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19a2898da0442d08b0c3b4599430054)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:30.854374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:31.200285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19a2898da0442d08b0c3b4599430054'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:31.213884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19a2898da0442d08b0c3b4599430054'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:31.214627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19a2898da0442d08b0c3b4599430054'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:31.221613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19a2898da0442d08b0c3b4599430054'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:31.386508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ff0dda63-2d19-49d7-823b-b78f4ae9d55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19a2898da0442d08b0c3b4599430054'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:31.393270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1008/2010] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:30 2022] DELETE /identity/v3/users/a19a2898da0442d08b0c3b4599430054 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:31.962862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:31.962862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:31.982113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077426-ab46-454c-9494-ad357e558065 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:32.100597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:32.101284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.101569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.101851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] PATH_INFO: `/v3/projects/92e50b2e7dfa4173a0240aba5dd2a2fd` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.103174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e50b2e7dfa4173a0240aba5dd2a2fd)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:32.105489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:32.284355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e50b2e7dfa4173a0240aba5dd2a2fd', 'request_id': 'req-ab20ed35-1946-4d86-984b-80a19157a08f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.290189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e50b2e7dfa4173a0240aba5dd2a2fd', 'request_id': 'req-ab20ed35-1946-4d86-984b-80a19157a08f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.296579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e50b2e7dfa4173a0240aba5dd2a2fd', 'request_id': 'req-ab20ed35-1946-4d86-984b-80a19157a08f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.427964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] The token cache is being invalidate because project 92e50b2e7dfa4173a0240aba5dd2a2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:32.428334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.428935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.431418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1003/2011] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:31 2022] DELETE /identity/v3/projects/92e50b2e7dfa4173a0240aba5dd2a2fd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:32.437039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5475-df0a-4bcc-9931-06736526ba77 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.437541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5475-df0a-4bcc-9931-06736526ba77 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.437971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5475-df0a-4bcc-9931-06736526ba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.460729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-807e5475-df0a-4bcc-9931-06736526ba77 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:32.463691 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-807e5475-df0a-4bcc-9931-06736526ba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:32.528628 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1009/2012] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:32.529830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:32.539514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:32.546951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7ae1-f8c6-4bc3-a40f-692416e1a2fc None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.547283 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7ae1-f8c6-4bc3-a40f-692416e1a2fc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.547510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7ae1-f8c6-4bc3-a40f-692416e1a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.547796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20ed35-1946-4d86-984b-80a19157a08f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:32.554520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:32.555277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.556167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.556855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] PATH_INFO: `/v3/users/9d0c8943d82c4a6dac6e45084b026a96` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.558883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0c8943d82c4a6dac6e45084b026a96)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:32.561925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:32.571454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4f6f7ae1-f8c6-4bc3-a40f-692416e1a2fc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:32.573138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4f6f7ae1-f8c6-4bc3-a40f-692416e1a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:32.584582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1010/2013] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:32.590174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7ae1-f8c6-4bc3-a40f-692416e1a2fc None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:32.600850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7ae1-f8c6-4bc3-a40f-692416e1a2fc None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:32.610540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:32.610540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.610540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.610540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.611179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:32.611179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:32.611179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:32.624101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1011/2014] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:32.629452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:32.640145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fd055-5de4-40ef-84ea-8a3ad21f5a31 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:32.645093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:32.645697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.646051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.646320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.646974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:32.648874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:32.803936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1012/2015] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:32 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:32.808698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:32.875251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014503-5b04-4982-9b65-474eed3f301c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:32.881824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:32.882456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.882735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.883010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.883672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:32.885688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:32.892121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0c8943d82c4a6dac6e45084b026a96'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.906800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0c8943d82c4a6dac6e45084b026a96'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.914480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0c8943d82c4a6dac6e45084b026a96'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:32.962917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:33.036421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1013/2016] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:32 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:33.038129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:33.049157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025de51f-77af-44ab-bf1c-dd80de803c63 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:33.054852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:33.055986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.056260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.056673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.057226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:33.058931 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:33.061812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0c8943d82c4a6dac6e45084b026a96'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:33.062910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c07c8b45-99bc-4158-af1c-46234a03a7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0c8943d82c4a6dac6e45084b026a96'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:33.077010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1004/2017] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:32 2022] DELETE /identity/v3/users/9d0c8943d82c4a6dac6e45084b026a96 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:33.083227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.084058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.084735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.099593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1014/2018] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:33.104189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:33.107980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:33.131085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:33.131245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04076-f7db-4089-8361-9515a2991d51 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:33.133425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:33.237623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1005/2019] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:33.254140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:33.255982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:33.281484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:33.283502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.284248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.284832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.286911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:33.290838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:33.316872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1015/2020] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:33.331055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:33.353876 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c4088-9c41-4bef-be95-3ae4dca56b90 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:33.378709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:33.378709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.378709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.378709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] PATH_INFO: `/v3/projects/3fb1f24468e54a0daebc283cbf22c795/users/9ed72b992c8f41bbafc6d890626d8dd2/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.383676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb1f24468e54a0daebc283cbf22c795, user_id=9ed72b992c8f41bbafc6d890626d8dd2, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:33.386930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c9f72-bab1-40ba-92e8-ce367bf79b28 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:33.387081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:33.391681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d9bb-f5aa-4880-b3b8-ef214a4ba8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:33.392284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d9bb-f5aa-4880-b3b8-ef214a4ba8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.392595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d9bb-f5aa-4880-b3b8-ef214a4ba8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.393026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d9bb-f5aa-4880-b3b8-ef214a4ba8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.403236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d9bb-f5aa-4880-b3b8-ef214a4ba8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:33.404691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d9bb-f5aa-4880-b3b8-ef214a4ba8f0 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:33.415486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1006/2021] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:33.538216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1016/2022] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:33 2022] PUT /identity/v3/projects/3fb1f24468e54a0daebc283cbf22c795/users/9ed72b992c8f41bbafc6d890626d8dd2/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:33.544057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.544343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.544630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.564287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:33.565554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:33.631787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1007/2023] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:33.643161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:33.645194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:33.728778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f557a78-7855-4ccd-848a-3b694b3b4680 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:33.736062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:33.737186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.737186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.737186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.747948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:33.749538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:33.760862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1017/2024] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:33.941650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:33.977720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:33.978921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:33.996483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714e2e9-9c57-46ab-adb5-6d2c424f1f91 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:34.002493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:34.003239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:34.003483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:34.003901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] PATH_INFO: `/v3/projects/d49119a2bdc74a68a0e0297136aa90f9` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:34.005448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49119a2bdc74a68a0e0297136aa90f9)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:34.007432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:34.210932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49119a2bdc74a68a0e0297136aa90f9', 'request_id': 'req-bbe5db7e-d355-474b-bd91-7a3396d4676a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.217808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49119a2bdc74a68a0e0297136aa90f9', 'request_id': 'req-bbe5db7e-d355-474b-bd91-7a3396d4676a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.224283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49119a2bdc74a68a0e0297136aa90f9', 'request_id': 'req-bbe5db7e-d355-474b-bd91-7a3396d4676a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.323928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:34.325452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:34.340233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51b48-0651-471e-b937-24aaad5f7d93 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:34.341314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] The token cache is being invalidate because project d49119a2bdc74a68a0e0297136aa90f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:34.345332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.345332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.345332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1008/2025] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:33 2022] DELETE /identity/v3/projects/d49119a2bdc74a68a0e0297136aa90f9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:34.350045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:34.351773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:34.424233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:34.425410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:34.425910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:34.426723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] PATH_INFO: `/v3/users/af2e285760c04c8d8ae527babc578ed1` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:34.428630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2e285760c04c8d8ae527babc578ed1)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:34.431418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:34.432776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5db7e-d355-474b-bd91-7a3396d4676a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:34.438326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:34.439353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:34.439353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:34.439557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] PATH_INFO: `/v3/users/775a193798744067bd8222accc99933f` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:34.440694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775a193798744067bd8222accc99933f)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:34.443025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:34.747611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2e285760c04c8d8ae527babc578ed1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.763024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2e285760c04c8d8ae527babc578ed1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.764499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2e285760c04c8d8ae527babc578ed1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.775788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2e285760c04c8d8ae527babc578ed1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.787596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775a193798744067bd8222accc99933f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.808775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775a193798744067bd8222accc99933f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.816894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775a193798744067bd8222accc99933f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.930063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-27e3d887-6bab-4be5-b5d7-9ba192ddc49a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2e285760c04c8d8ae527babc578ed1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:34.941222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1018/2026] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:34 2022] DELETE /identity/v3/users/af2e285760c04c8d8ae527babc578ed1 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:34.944330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f279-b7ac-4277-ad2d-6cde439ebc8c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:34.944629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f279-b7ac-4277-ad2d-6cde439ebc8c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:34.944911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f279-b7ac-4277-ad2d-6cde439ebc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:34.980334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f333f279-b7ac-4277-ad2d-6cde439ebc8c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:34.981591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f333f279-b7ac-4277-ad2d-6cde439ebc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:35.048772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775a193798744067bd8222accc99933f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:35.048996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775a193798744067bd8222accc99933f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:35.056827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1009/2027] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:34 2022] DELETE /identity/v3/users/775a193798744067bd8222accc99933f => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:35.077615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1019/2028] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:35.102380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:35.105906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:35.187180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e077b-41fb-4c83-a07e-1e4ddc1de5a4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:35.190978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:35.191626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:35.191918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:35.198951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:35.268106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:35.269639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:35.282435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1010/2029] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:35.784714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:35.786727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:35.786971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:35.854413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] MFA Rules not processed for user `9ed72b992c8f41bbafc6d890626d8dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:35.856128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:35.971312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1020/2030] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:35.975680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:35.977248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:35.996726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532ae3-2d7e-455c-9e1e-af27681183de service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:36.005767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:36.006695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.007432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.007873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.008085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:36.010320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:36.010622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:36.013821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:36.038869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798e76f-e8fe-4db7-b17d-99560f7cf20c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:36.048057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:36.048818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.049124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.049429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] PATH_INFO: `/v3/projects/34fdfa5e696045b49d2bfa40e5bb240f` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.050564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fdfa5e696045b49d2bfa40e5bb240f)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:36.054398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:36.308063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1011/2031] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:35 2022] POST /identity/v3/projects => generated 371 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:36.315600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:36.326193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fdfa5e696045b49d2bfa40e5bb240f', 'request_id': 'req-8452ef3f-5876-418f-99ad-5438dc0850c5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:36.391258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c697-ef88-4597-9d59-6be78da4e937 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:36.396760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca773ec-8a0a-4141-b842-f8a3052cc504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:36.397426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca773ec-8a0a-4141-b842-f8a3052cc504 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.397710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca773ec-8a0a-4141-b842-f8a3052cc504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.397984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca773ec-8a0a-4141-b842-f8a3052cc504 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.398660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca773ec-8a0a-4141-b842-f8a3052cc504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:36.400635 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca773ec-8a0a-4141-b842-f8a3052cc504 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:36.541610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fdfa5e696045b49d2bfa40e5bb240f', 'request_id': 'req-8452ef3f-5876-418f-99ad-5438dc0850c5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:36.548387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fdfa5e696045b49d2bfa40e5bb240f', 'request_id': 'req-8452ef3f-5876-418f-99ad-5438dc0850c5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:36.560976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] The token cache is being invalidate because project 34fdfa5e696045b49d2bfa40e5bb240f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:36.561481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:36.562208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:36.563775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1021/2032] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:36 2022] DELETE /identity/v3/projects/34fdfa5e696045b49d2bfa40e5bb240f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:36.564543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:36.566015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:36.615144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1012/2033] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:36 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:36.616530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.616851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.617285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.640079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:36.641369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:36.653367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:36.657872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1013/2034] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:36.658523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452ef3f-5876-418f-99ad-5438dc0850c5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:36.658805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:36.660423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:36.665649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:36.666537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.666963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.667383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] PATH_INFO: `/v3/projects/42de41c616664bb2b0c6cb211333ca36` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.668874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42de41c616664bb2b0c6cb211333ca36)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:36.671184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:36.673024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46377013-9dad-4e8e-b68c-5e91f0857979 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:36.677827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7658c-7f07-4871-979e-f029e3ad1f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:36.678443 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7658c-7f07-4871-979e-f029e3ad1f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.678723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7658c-7f07-4871-979e-f029e3ad1f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.678994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7658c-7f07-4871-979e-f029e3ad1f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.679649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7658c-7f07-4871-979e-f029e3ad1f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:36.681471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7658c-7f07-4871-979e-f029e3ad1f92 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:36.692467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1014/2035] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:36.693991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dbc01-92b5-40f7-87aa-cb8a5f0fd2ec None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.694278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dbc01-92b5-40f7-87aa-cb8a5f0fd2ec None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.694548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dbc01-92b5-40f7-87aa-cb8a5f0fd2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.726724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3c7dbc01-92b5-40f7-87aa-cb8a5f0fd2ec None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:36.728795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3c7dbc01-92b5-40f7-87aa-cb8a5f0fd2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:36.745122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1015/2036] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:36.745122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dbc01-92b5-40f7-87aa-cb8a5f0fd2ec None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:36.756905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dbc01-92b5-40f7-87aa-cb8a5f0fd2ec None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:36.765000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:36.765765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:36.766113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:36.766395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] PATH_INFO: `/v3/projects/193197a4b9784837be064621b12d6428/users/b0eb725c496c44dca5cb88ad240e31d5/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:36.785557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=193197a4b9784837be064621b12d6428, user_id=b0eb725c496c44dca5cb88ad240e31d5, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:36.788567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:36.930102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1016/2037] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:36 2022] PUT /identity/v3/projects/193197a4b9784837be064621b12d6428/users/b0eb725c496c44dca5cb88ad240e31d5/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:36.931649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:36.938832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42de41c616664bb2b0c6cb211333ca36', 'request_id': 'req-a1089150-22f1-47aa-bd50-9a1f94a56384'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.031067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84187-4cfd-4e02-bb95-957e73bd0eec admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.061974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42de41c616664bb2b0c6cb211333ca36', 'request_id': 'req-a1089150-22f1-47aa-bd50-9a1f94a56384'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.069334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42de41c616664bb2b0c6cb211333ca36', 'request_id': 'req-a1089150-22f1-47aa-bd50-9a1f94a56384'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.084217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] The token cache is being invalidate because project 42de41c616664bb2b0c6cb211333ca36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:37.084639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.086428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.090768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.091520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.091926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.092300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.093079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:37.093578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.094997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1022/2038] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:36 2022] DELETE /identity/v3/projects/42de41c616664bb2b0c6cb211333ca36 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:37.095411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.095641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.099179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:37.109116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1017/2039] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:37.110289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.112238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:37.115717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1089150-22f1-47aa-bd50-9a1f94a56384 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.121367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.122261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.122730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.123854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.124886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.126694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.129975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143488a6-0616-4cf3-b267-61871a8b9946 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.136496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.137727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.138282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.138491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] PATH_INFO: `/v3/users/b35cd5563d5b412ea5be28063d39a60d` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.140105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35cd5563d5b412ea5be28063d39a60d)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.150647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.150996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1023/2040] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:37.150996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.157981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:37.184163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7a8e-f901-4059-8121-a7f79c874f9d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.186821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.187442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.187721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.187993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.188631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.190538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.209973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:37.326744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1024/2041] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:37 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:37.327905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.395731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337232-c70a-4f15-818d-f94953efeb0a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.401587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.402308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.402814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.403109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] PATH_INFO: `/v3/projects/193197a4b9784837be064621b12d6428/users/b0eb725c496c44dca5cb88ad240e31d5/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.405542 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] RBAC: Authorizing `identity:create_grant(project_id=193197a4b9784837be064621b12d6428, user_id=b0eb725c496c44dca5cb88ad240e31d5, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.408274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.425368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1025/2042] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:37 2022] PUT /identity/v3/projects/193197a4b9784837be064621b12d6428/users/b0eb725c496c44dca5cb88ad240e31d5/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:37.425368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.469690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35cd5563d5b412ea5be28063d39a60d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.494633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35cd5563d5b412ea5be28063d39a60d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.504786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35cd5563d5b412ea5be28063d39a60d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.510743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a5e3a-bf44-417d-935d-df96cea4757a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.525497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.526363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.526790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.527141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.527945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.530320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.662098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35cd5563d5b412ea5be28063d39a60d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.663958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35cd5563d5b412ea5be28063d39a60d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:37.668973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1026/2043] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:37 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:37.673199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.674588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1018/2044] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:37 2022] DELETE /identity/v3/users/b35cd5563d5b412ea5be28063d39a60d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:37.681982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:37.700431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ad01-6025-4301-b5bf-25f87364c99f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.776631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.777315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.778137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.778137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.778518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.780182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.794839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1027/2045] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:37.796560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.812267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279294b7-7fa8-4260-9fa3-a75eb45eb7e1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.819206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc8924-259b-4ad4-88e7-a70d28e100ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.819394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc8924-259b-4ad4-88e7-a70d28e100ae admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.819621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc8924-259b-4ad4-88e7-a70d28e100ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.820010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc8924-259b-4ad4-88e7-a70d28e100ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.820505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc8924-259b-4ad4-88e7-a70d28e100ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.822445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc8924-259b-4ad4-88e7-a70d28e100ae admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:37.867642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:37.871690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1019/2046] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:37.898059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25de6e-656d-45d5-be4a-a754f42c4526 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:37.907382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:37.908328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:37.908814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:37.909747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] PATH_INFO: `/v3/projects/d6add994005e44fd9096716776f0f63f/users/aad09e446e00448192b9de7f05e0c2bd/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:37.929172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6add994005e44fd9096716776f0f63f, user_id=aad09e446e00448192b9de7f05e0c2bd, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:37.932477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:38.067839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1028/2047] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:37 2022] PUT /identity/v3/projects/d6add994005e44fd9096716776f0f63f/users/aad09e446e00448192b9de7f05e0c2bd/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:38.071284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1db89-2ac0-4de5-b48c-b3861857d3b8 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.071581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1db89-2ac0-4de5-b48c-b3861857d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.072549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1db89-2ac0-4de5-b48c-b3861857d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.113161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-afe1db89-2ac0-4de5-b48c-b3861857d3b8 None None] MFA Rules not processed for user `aad09e446e00448192b9de7f05e0c2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:38.113161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-afe1db89-2ac0-4de5-b48c-b3861857d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:38.232473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1020/2048] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:38.235029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:38.317330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191ff7-dee1-44fc-a2b1-281169446e33 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:38.323402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:38.324346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.324965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.325518 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.326351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:38.328588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:38.498676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1db89-2ac0-4de5-b48c-b3861857d3b8 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:38.499573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1029/2049] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:38 2022] POST /identity/v3/projects => generated 387 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:38.513280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1db89-2ac0-4de5-b48c-b3861857d3b8 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:38.568591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:38.578526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:38.580368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:38.593041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:38.593997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.594484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.594846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.595703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:38.598740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:38.696697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f279e-f56f-4bb0-a7e0-43e51812be64 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:38.702253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:38.702946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.703332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.704323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] PATH_INFO: `/v3/projects/fe0f3db1fec54954b5226bb61a7338cc` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.705924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0f3db1fec54954b5226bb61a7338cc)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:38.708152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:38.865363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1021/2050] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:38 2022] POST /identity/v3/users => generated 300 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:38.869693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:38.887334 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af679-f6c1-40eb-b279-4d3782f342bc admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:38.893730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:38.894675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.895206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.896186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.897080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:38.899146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:38.912341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1022/2051] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:38.924477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:38.937403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf918502-2ce9-4737-8a05-308f8b36b7b9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:38.944540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:38.945259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.945539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.945815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] PATH_INFO: `/v3/projects/d8adbc458a5147089cd46b4898d3c95e/users/5b8ff5b5acb24d718272a25e6ca24655/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.973023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8adbc458a5147089cd46b4898d3c95e, user_id=5b8ff5b5acb24d718272a25e6ca24655, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:38.973023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:39.109206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1023/2052] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:38 2022] PUT /identity/v3/projects/d8adbc458a5147089cd46b4898d3c95e/users/5b8ff5b5acb24d718272a25e6ca24655/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:39.115577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:39.138098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0f3db1fec54954b5226bb61a7338cc', 'request_id': 'req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.192238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352cfec-1e39-42ae-a113-3a2efa278fd7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:39.253289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:39.253854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:39.254164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:39.254430 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:39.255080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:39.256719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:39.278107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1024/2053] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:39.282593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:39.293500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd99f3c-bd2d-46b8-bba8-8978f9537c63 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:39.299337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec3036-25fc-4168-8847-aaa9d821755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:39.300371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3036-25fc-4168-8847-aaa9d821755f admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:39.300825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3036-25fc-4168-8847-aaa9d821755f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:39.301369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3036-25fc-4168-8847-aaa9d821755f admin admin] PATH_INFO: `/v3/projects/d8adbc458a5147089cd46b4898d3c95e/users/5b8ff5b5acb24d718272a25e6ca24655/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:39.302939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0f3db1fec54954b5226bb61a7338cc', 'request_id': 'req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.304167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec3036-25fc-4168-8847-aaa9d821755f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8adbc458a5147089cd46b4898d3c95e, user_id=5b8ff5b5acb24d718272a25e6ca24655, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:39.308281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec3036-25fc-4168-8847-aaa9d821755f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:39.327441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1025/2054] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:39 2022] PUT /identity/v3/projects/d8adbc458a5147089cd46b4898d3c95e/users/5b8ff5b5acb24d718272a25e6ca24655/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:39.334110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0f3db1fec54954b5226bb61a7338cc', 'request_id': 'req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.338603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f6e95-63b6-4b22-bfa7-4fa02ffbf553 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:39.338603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f6e95-63b6-4b22-bfa7-4fa02ffbf553 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:39.338603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f6e95-63b6-4b22-bfa7-4fa02ffbf553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:39.413028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] The token cache is being invalidate because project fe0f3db1fec54954b5226bb61a7338cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:39.413679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.415787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-467f6e95-63b6-4b22-bfa7-4fa02ffbf553 None None] MFA Rules not processed for user `5b8ff5b5acb24d718272a25e6ca24655`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:39.417551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-467f6e95-63b6-4b22-bfa7-4fa02ffbf553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:39.419620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.431661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1030/2055] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:38 2022] DELETE /identity/v3/projects/fe0f3db1fec54954b5226bb61a7338cc => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:39.432982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:39.437198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:39.455945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733cb2-c6ff-4c6a-8be2-3d5159e03e56 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:39.545102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1026/2056] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:39.545102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:39.545102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:39.545102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:39.567537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:39.568208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:39.568505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:39.568765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] PATH_INFO: `/v3/users/a665fa31ee514314b0f957c7dccf9399` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:39.570086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a665fa31ee514314b0f957c7dccf9399)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:39.572200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:39.590791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] MFA Rules not processed for user `b0eb725c496c44dca5cb88ad240e31d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:39.592064 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:39.695784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1027/2057] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:39.696882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:39.698378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:39.814150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbdc98-d3e2-4f51-aa86-a0169e86d6ed None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:39.822029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66ff7c-957c-4473-b73f-15acbbce1b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:39.823364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66ff7c-957c-4473-b73f-15acbbce1b9f service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:39.823808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66ff7c-957c-4473-b73f-15acbbce1b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:39.824441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66ff7c-957c-4473-b73f-15acbbce1b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:39.863521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66ff7c-957c-4473-b73f-15acbbce1b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:39.866359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66ff7c-957c-4473-b73f-15acbbce1b9f service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:39.877458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a665fa31ee514314b0f957c7dccf9399'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.886288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1028/2058] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:39.888661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:39.889186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:39.889670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:39.894576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a665fa31ee514314b0f957c7dccf9399'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.896103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a665fa31ee514314b0f957c7dccf9399'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:39.926035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] MFA Rules not processed for user `9ed72b992c8f41bbafc6d890626d8dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:39.928292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:39.932721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a665fa31ee514314b0f957c7dccf9399'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:40.052650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1029/2059] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:40.071631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:40.080211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:40.093803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a665fa31ee514314b0f957c7dccf9399'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:40.110494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1031/2060] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:39 2022] DELETE /identity/v3/users/a665fa31ee514314b0f957c7dccf9399 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:40.153477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:40.154948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:40.251530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451ae6a-db26-4221-87cd-46ab31efe2eb None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:40.280303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c3e62-6adb-494a-88d4-7867ab0e4b6b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:40.286891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:40.287733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:40.288146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:40.288523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] PATH_INFO: `/v3/users/aad09e446e00448192b9de7f05e0c2bd` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:40.291538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad09e446e00448192b9de7f05e0c2bd)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:40.294174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:40.387359 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:40.388327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:40.388619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:40.389119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:40.393386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:40.413515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:40.597255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:40.598901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:40.610964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1030/2061] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:40.620838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad09e446e00448192b9de7f05e0c2bd'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:40.638594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad09e446e00448192b9de7f05e0c2bd'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:40.639855 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad09e446e00448192b9de7f05e0c2bd'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:40.653403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad09e446e00448192b9de7f05e0c2bd'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:40.820744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-015ec86a-1b58-437a-abb2-60f6262b18ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad09e446e00448192b9de7f05e0c2bd'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:40.834224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:40.835708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:40.838723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1032/2062] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:40 2022] DELETE /identity/v3/users/aad09e446e00448192b9de7f05e0c2bd => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:40.847380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:40.847755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:40.848059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:40.870616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5236-e82d-4e91-80f1-808b101f352f service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:40.896057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:40.896057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:40.967005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:40.969234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:40.969755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:40.970310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] PATH_INFO: `/v3/projects/c81145eead1b4faea2991f272a2d906a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:40.971909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81145eead1b4faea2991f272a2d906a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:40.983660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:41.019806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1033/2063] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:41.041461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:41.043645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:41.129588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e156b-a8e9-44f3-8a79-2aab0b1de7f8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:41.154969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81145eead1b4faea2991f272a2d906a', 'request_id': 'req-a11df15d-3ba3-4891-a650-0bb9603f75e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.164070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81145eead1b4faea2991f272a2d906a', 'request_id': 'req-a11df15d-3ba3-4891-a650-0bb9603f75e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.176957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81145eead1b4faea2991f272a2d906a', 'request_id': 'req-a11df15d-3ba3-4891-a650-0bb9603f75e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.204149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33f9e4-53e9-48a7-bea6-c381d09a67e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:41.205427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f9e4-53e9-48a7-bea6-c381d09a67e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:41.205884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f9e4-53e9-48a7-bea6-c381d09a67e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:41.206151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f9e4-53e9-48a7-bea6-c381d09a67e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:41.276583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33f9e4-53e9-48a7-bea6-c381d09a67e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:41.278066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33f9e4-53e9-48a7-bea6-c381d09a67e0 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:41.287238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] The token cache is being invalidate because project c81145eead1b4faea2991f272a2d906a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:41.287238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.288449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.298705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1031/2064] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:40 2022] DELETE /identity/v3/projects/c81145eead1b4faea2991f272a2d906a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:41.298705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:41.298705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:41.299092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1034/2065] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:41.300598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf226-fc7c-4c9f-b10c-11719dad436d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:41.300937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf226-fc7c-4c9f-b10c-11719dad436d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:41.301274 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf226-fc7c-4c9f-b10c-11719dad436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:41.316069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11df15d-3ba3-4891-a650-0bb9603f75e4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:41.324614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:41.325733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:41.326193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:41.326606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] PATH_INFO: `/v3/users/d5778532fdeb49aa80bebc165208165b` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:41.328077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5778532fdeb49aa80bebc165208165b)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:41.329473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b8bbf226-fc7c-4c9f-b10c-11719dad436d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:41.330783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:41.331020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b8bbf226-fc7c-4c9f-b10c-11719dad436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:41.343071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1035/2066] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:41.354144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de586bf2-8827-403e-a1bd-06c0a1583700 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:41.354407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de586bf2-8827-403e-a1bd-06c0a1583700 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:41.354751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de586bf2-8827-403e-a1bd-06c0a1583700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:41.381260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-de586bf2-8827-403e-a1bd-06c0a1583700 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:41.382519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-de586bf2-8827-403e-a1bd-06c0a1583700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:41.392851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1036/2067] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:41.400840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de586bf2-8827-403e-a1bd-06c0a1583700 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:41.415524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de586bf2-8827-403e-a1bd-06c0a1583700 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:41.425591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:41.426715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:41.427282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:41.427997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:41.428978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:41.429552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:41.432572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:41.452574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1037/2068] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:41.459298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:41.480624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf1996-2f9a-4c82-a28d-5f65212f0381 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:41.491195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:41.492351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:41.501259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:41.501259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:41.501259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:41.501259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:41.673997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1038/2069] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:41 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:41.677242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:41.678985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5778532fdeb49aa80bebc165208165b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.720280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5778532fdeb49aa80bebc165208165b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.730733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5778532fdeb49aa80bebc165208165b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.798240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5778532fdeb49aa80bebc165208165b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.799169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5778532fdeb49aa80bebc165208165b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:41.808272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1032/2070] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:41 2022] DELETE /identity/v3/users/d5778532fdeb49aa80bebc165208165b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:41.822661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a53df-f328-4de7-8684-988f1aab22a6 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:41.848487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=20,keystone:SELECT=77,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:42.127819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:42.127819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:42.127819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:42.127819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:42.130085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:42.130085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:42.179676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:42.181688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:42.204664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17905f-2634-4d44-965b-4b178cc09f02 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:42.210858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:42.221711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:42.221711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:42.221711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] PATH_INFO: `/v3/projects/d6add994005e44fd9096716776f0f63f` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:42.221711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6add994005e44fd9096716776f0f63f)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:42.221711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:42.262739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1039/2071] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:41 2022] POST /identity/v3/users => generated 293 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:42.263451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:42.265428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:42.279342 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a630f06-20cc-4d7e-9a14-bd4c64039a98 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:42.295206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:42.296457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:42.296899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:42.297245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] PATH_INFO: `/v3/projects/49e1255c9a2d4b4086c1fecebad74952` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:42.304494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e1255c9a2d4b4086c1fecebad74952)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:42.314714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:42.527045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6add994005e44fd9096716776f0f63f', 'request_id': 'req-aecf659d-6256-474e-b89f-f2e97bb65eee'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.533592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6add994005e44fd9096716776f0f63f', 'request_id': 'req-aecf659d-6256-474e-b89f-f2e97bb65eee'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.540676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6add994005e44fd9096716776f0f63f', 'request_id': 'req-aecf659d-6256-474e-b89f-f2e97bb65eee'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.581005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e1255c9a2d4b4086c1fecebad74952', 'request_id': 'req-ee4e2849-a14d-41c8-98f1-d14e5868251b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.706215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] The token cache is being invalidate because project d6add994005e44fd9096716776f0f63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:42.706215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.706215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.706215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1033/2072] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:42 2022] DELETE /identity/v3/projects/d6add994005e44fd9096716776f0f63f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:42.706215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:42.707173 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:42.792319 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf659d-6256-474e-b89f-f2e97bb65eee admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:42.860323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:42.860966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:42.861286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:42.861563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:42.862221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:42.864312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:42.878606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e1255c9a2d4b4086c1fecebad74952', 'request_id': 'req-ee4e2849-a14d-41c8-98f1-d14e5868251b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.882877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1034/2073] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:42.882877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:42.886930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:42.887784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e1255c9a2d4b4086c1fecebad74952', 'request_id': 'req-ee4e2849-a14d-41c8-98f1-d14e5868251b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.901115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] The token cache is being invalidate because project 49e1255c9a2d4b4086c1fecebad74952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:42.901326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.901983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:42.903640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1040/2074] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:42 2022] DELETE /identity/v3/projects/49e1255c9a2d4b4086c1fecebad74952 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:42.904425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:42.905926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:42.906590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c59c-3cfe-4f29-9ba3-911ae1844cc5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:42.913435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:42.914179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:42.914501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:42.915450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] PATH_INFO: `/v3/users/5b8ff5b5acb24d718272a25e6ca24655` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:42.917392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8ff5b5acb24d718272a25e6ca24655)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:42.922896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:42.923062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e2849-a14d-41c8-98f1-d14e5868251b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:42.926594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:42.927271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:42.927544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:42.927817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] PATH_INFO: `/v3/users/4f44d748272240849d6a663e9ba95321` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:42.929023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f44d748272240849d6a663e9ba95321)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:42.931875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:43.262291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8ff5b5acb24d718272a25e6ca24655'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.283749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8ff5b5acb24d718272a25e6ca24655'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.295925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8ff5b5acb24d718272a25e6ca24655'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.312593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:43.357865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f44d748272240849d6a663e9ba95321'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.372579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f44d748272240849d6a663e9ba95321'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.373511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f44d748272240849d6a663e9ba95321'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.375088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8ff5b5acb24d718272a25e6ca24655'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.375970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8ff5b5acb24d718272a25e6ca24655'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.387019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1035/2075] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:42 2022] DELETE /identity/v3/users/5b8ff5b5acb24d718272a25e6ca24655 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:43.387019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:43.387019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.387428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f44d748272240849d6a663e9ba95321'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.476602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f928448-384d-4da0-8207-9dd774a922c5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:43.483700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3689a-6c55-4005-909c-2747ac1d464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:43.488078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3689a-6c55-4005-909c-2747ac1d464a admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.488078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3689a-6c55-4005-909c-2747ac1d464a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.488078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3689a-6c55-4005-909c-2747ac1d464a admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.488078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3689a-6c55-4005-909c-2747ac1d464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:43.488078 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3689a-6c55-4005-909c-2747ac1d464a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:43.505525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1036/2076] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:43.507784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f1fb6-5b46-4303-9259-340ad49436d3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.508330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f1fb6-5b46-4303-9259-340ad49436d3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.508829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f1fb6-5b46-4303-9259-340ad49436d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.517499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f44d748272240849d6a663e9ba95321'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:43.528649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1041/2077] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:42 2022] DELETE /identity/v3/users/4f44d748272240849d6a663e9ba95321 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:43.529820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:43.531791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.546756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ee8f1fb6-5b46-4303-9259-340ad49436d3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:43.549676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ee8f1fb6-5b46-4303-9259-340ad49436d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.649632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1037/2078] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:43.650602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8061a5-c09c-48b1-b409-3df0238e8c20 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:43.652486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f09a-d750-4d22-b139-487872a6fb76 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.652821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f09a-d750-4d22-b139-487872a6fb76 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.653258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f09a-d750-4d22-b139-487872a6fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.665860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:43.668245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.668755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.669299 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] PATH_INFO: `/v3/projects/bd093d5a16114cc3a180a8713e1fe9c9/users/fcee7eaf1cfb441c91b35a6c45cff5fe/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.680134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a884f09a-d750-4d22-b139-487872a6fb76 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:43.681632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a884f09a-d750-4d22-b139-487872a6fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.697373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1038/2079] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:43.697373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.697373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.697373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.700541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd093d5a16114cc3a180a8713e1fe9c9, user_id=fcee7eaf1cfb441c91b35a6c45cff5fe, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:43.706767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:43.721416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:43.722898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.736552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1039/2080] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:43.762937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:43.762937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.846113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3227-0175-4113-93aa-1bb8ab607cee None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:43.860694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177d4f6-8111-47b1-a78b-7020f81587bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:43.861568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177d4f6-8111-47b1-a78b-7020f81587bf service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.861849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177d4f6-8111-47b1-a78b-7020f81587bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.862121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177d4f6-8111-47b1-a78b-7020f81587bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.890930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177d4f6-8111-47b1-a78b-7020f81587bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:43.890930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177d4f6-8111-47b1-a78b-7020f81587bf service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:43.891162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1042/2081] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:43 2022] PUT /identity/v3/projects/bd093d5a16114cc3a180a8713e1fe9c9/users/fcee7eaf1cfb441c91b35a6c45cff5fe/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:43.891162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:43.895790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1040/2082] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:43.904355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea906f-fa4a-4f03-bd03-6b36647eb0ed None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.904649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea906f-fa4a-4f03-bd03-6b36647eb0ed None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.904936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea906f-fa4a-4f03-bd03-6b36647eb0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.941331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b4ea906f-fa4a-4f03-bd03-6b36647eb0ed None None] MFA Rules not processed for user `fcee7eaf1cfb441c91b35a6c45cff5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:43.942997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b4ea906f-fa4a-4f03-bd03-6b36647eb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.973455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a7e41-7a0f-4f4c-a533-76383f0e447e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:43.980768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:43.981720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.982847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.983108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.983812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:43.984124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:43.986122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.014928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1043/2083] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:44.020171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.034639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3d73-8f10-4ea1-906e-b5d65821fd7c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.040814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.041565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.041845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.042119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.042786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.044780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.090803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1041/2084] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:44.096229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea906f-fa4a-4f03-bd03-6b36647eb0ed None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.112068 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea906f-fa4a-4f03-bd03-6b36647eb0ed None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.118479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.119184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.119381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.119661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.120332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.122311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.207333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1044/2085] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:44 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:44.209826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.213602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:44.261664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1042/2086] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:44 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:44.262810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.343072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38fb2-f222-4347-a2ed-9cf9cd71e901 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.349182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.350105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.350526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.350951 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.351631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225086d-7223-4018-8499-28496f56a41b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.351838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.354052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.356971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.357662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.358246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.358806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] PATH_INFO: `/v3/projects/d8adbc458a5147089cd46b4898d3c95e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.359718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8adbc458a5147089cd46b4898d3c95e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.361732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.489942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1043/2087] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:44 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:44.490785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.501938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f145-cad8-4740-b873-471eb47ca69d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.507435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.508066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.508348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.508714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.509413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.511496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.538547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8adbc458a5147089cd46b4898d3c95e', 'request_id': 'req-34be5f1a-6cd9-47ac-9fca-35ae52a82873'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:44.616047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8adbc458a5147089cd46b4898d3c95e', 'request_id': 'req-34be5f1a-6cd9-47ac-9fca-35ae52a82873'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:44.628333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8adbc458a5147089cd46b4898d3c95e', 'request_id': 'req-34be5f1a-6cd9-47ac-9fca-35ae52a82873'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:44.641538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1044/2088] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:44 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:44.643627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.645796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] The token cache is being invalidate because project d8adbc458a5147089cd46b4898d3c95e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:44.646097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:44.646835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:44.648782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1045/2089] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:44 2022] DELETE /identity/v3/projects/d8adbc458a5147089cd46b4898d3c95e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:44.650462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.651891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:44.662311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd2bc-0cee-49ac-bb8c-625ede86666e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.748776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be5f1a-6cd9-47ac-9fca-35ae52a82873 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.749947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.750583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.750864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.751138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.751828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.753529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.757191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.764906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.764906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.764906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] PATH_INFO: `/v3/projects/99f0044e87754976b711112fdeedb6d8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.764906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f0044e87754976b711112fdeedb6d8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.764906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.769394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1045/2090] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:44.769394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.771239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:44.784771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737b12b-812c-405b-b750-6cc69e5634fb admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.789894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915beaf7-dc69-48b8-9542-d82ff45b3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.790532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915beaf7-dc69-48b8-9542-d82ff45b3353 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.791022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915beaf7-dc69-48b8-9542-d82ff45b3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.791280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915beaf7-dc69-48b8-9542-d82ff45b3353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.792004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915beaf7-dc69-48b8-9542-d82ff45b3353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.793694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915beaf7-dc69-48b8-9542-d82ff45b3353 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.807527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1046/2091] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:44.809786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.810180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.810541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.841982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:44.844084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:44.860456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1047/2092] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:44.860456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.862213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:44.879636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d70f8f-a5f6-46ce-a560-fde511d6d76d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.897487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:44.897487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:44.897487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:44.897487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:44.898238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:44.898238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:44.900834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1048/2093] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:44.905008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:44.926855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e343f86-64c8-44d0-a3d1-65942437583d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:44.969007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f0044e87754976b711112fdeedb6d8', 'request_id': 'req-7ecddb51-817c-4e05-bf17-6da2a3775bf9'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.036673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:45.037639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.038157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.038639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] PATH_INFO: `/v3/projects/a2dbfe95547248e7af158e46c79a1fca/users/f0144796f3744a20a45e38570ad08b28/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.066472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dbfe95547248e7af158e46c79a1fca, user_id=f0144796f3744a20a45e38570ad08b28, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:45.070920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:45.173905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f0044e87754976b711112fdeedb6d8', 'request_id': 'req-7ecddb51-817c-4e05-bf17-6da2a3775bf9'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.181029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f0044e87754976b711112fdeedb6d8', 'request_id': 'req-7ecddb51-817c-4e05-bf17-6da2a3775bf9'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.193410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] The token cache is being invalidate because project 99f0044e87754976b711112fdeedb6d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:45.193700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.194509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7ecddb51-817c-4e05-bf17-6da2a3775bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.196307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1046/2094] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:44 2022] DELETE /identity/v3/projects/99f0044e87754976b711112fdeedb6d8 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:45.197970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.198234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.198504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.220033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:45.221320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.230214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1047/2095] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:45.231167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:45.236808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.237023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1049/2096] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:44 2022] PUT /identity/v3/projects/a2dbfe95547248e7af158e46c79a1fca/users/f0144796f3744a20a45e38570ad08b28/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:45.237023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:45.240624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.247570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286cb35-df7d-4bb7-bd6c-808a801bd344 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:45.325704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:45.326407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.326689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.326958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] PATH_INFO: `/v3/projects/486c66a13fc54f97a47341b1c55167c2/users/3383f068af3f4509b781b77a6b56da7a/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.336344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94906f3d-2a7a-4bd8-b91c-f86ee5184445 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:45.341760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:45.342410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.342684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.342819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486c66a13fc54f97a47341b1c55167c2, user_id=3383f068af3f4509b781b77a6b56da7a, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:45.342960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] PATH_INFO: `/v3/users/81e1b5a7c28540ea9ad3b6bcbfc44949` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.344118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e1b5a7c28540ea9ad3b6bcbfc44949)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:45.345646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:45.346125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:45.440007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1048/2097] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:45 2022] PUT /identity/v3/projects/486c66a13fc54f97a47341b1c55167c2/users/3383f068af3f4509b781b77a6b56da7a/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:45.440864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:45.504643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87b16b-3abd-4464-a063-00cfcddf9ea2 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:45.509500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:45.510105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.510384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.510811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.511426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:45.511730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:45.513346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:45.525842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1049/2098] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:45.526833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:45.528539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.541887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83afc-b35d-4fa5-bce5-e889201373e4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:45.547163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c46b-98ae-470e-abb5-61c879a025b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:45.547773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c46b-98ae-470e-abb5-61c879a025b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.548047 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c46b-98ae-470e-abb5-61c879a025b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.548314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c46b-98ae-470e-abb5-61c879a025b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.548960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c46b-98ae-470e-abb5-61c879a025b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:45.550623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c46b-98ae-470e-abb5-61c879a025b1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:45.561558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1050/2099] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:45.562783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4d565-a78a-4da2-93b1-7028abe7f7f2 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.563061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4d565-a78a-4da2-93b1-7028abe7f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.563330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4d565-a78a-4da2-93b1-7028abe7f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.582085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e1d4d565-a78a-4da2-93b1-7028abe7f7f2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:45.583202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e1d4d565-a78a-4da2-93b1-7028abe7f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.591785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1051/2100] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:45.592543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4d565-a78a-4da2-93b1-7028abe7f7f2 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:45.603412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4d565-a78a-4da2-93b1-7028abe7f7f2 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:45.609088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:45.609718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.610006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.610547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.611200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:45.613303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:45.690187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e1b5a7c28540ea9ad3b6bcbfc44949'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.712124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e1b5a7c28540ea9ad3b6bcbfc44949'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.725426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e1b5a7c28540ea9ad3b6bcbfc44949'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.826704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e1b5a7c28540ea9ad3b6bcbfc44949'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.827487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e1b5a7c28540ea9ad3b6bcbfc44949'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:45.843221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1052/2101] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:45 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:45.843557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1050/2102] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:45 2022] DELETE /identity/v3/users/81e1b5a7c28540ea9ad3b6bcbfc44949 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:45.843664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:45.843746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:45.843746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.851115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.910928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992e97-98bf-4543-b07e-5161e67fbf6c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:45.922986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba69440-7a51-44d7-b41f-ddf87ef2055c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:45.923940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69440-7a51-44d7-b41f-ddf87ef2055c service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.924284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69440-7a51-44d7-b41f-ddf87ef2055c service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.924633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69440-7a51-44d7-b41f-ddf87ef2055c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.928460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9ba69440-7a51-44d7-b41f-ddf87ef2055c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.941825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a6f6-34b4-4a3d-82b0-26d47f08660c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:45.976162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:46.053202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.053202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.053202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.053202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] PATH_INFO: `/v3/projects/a2dbfe95547248e7af158e46c79a1fca/users/f0144796f3744a20a45e38570ad08b28/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.053963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dbfe95547248e7af158e46c79a1fca, user_id=f0144796f3744a20a45e38570ad08b28, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.053963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.054318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba69440-7a51-44d7-b41f-ddf87ef2055c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.054318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba69440-7a51-44d7-b41f-ddf87ef2055c service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.056347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1053/2103] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:45 2022] PUT /identity/v3/projects/a2dbfe95547248e7af158e46c79a1fca/users/f0144796f3744a20a45e38570ad08b28/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:46.057962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:46.062494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:46.071445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1051/2104] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:46.072513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.072800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.077290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.134844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] MFA Rules not processed for user `f0144796f3744a20a45e38570ad08b28`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:46.135582 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:46.190552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47132ab-1536-4803-81a9-3db5d21950be admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:46.198854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.198854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.198854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.198854 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.199727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.202974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.222163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:46.265314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1052/2105] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:46.276549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:46.278594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:46.355877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1054/2106] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:46 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:46.368228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9986e0-d222-4a03-9e8c-aded22c6639f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:46.374521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:46.380962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.381936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.383034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.384642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.389775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ae669-37ac-4ea4-9b9e-a9b1683a675d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:46.396584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.397839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.398093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.398538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.399414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.401349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.409388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.412012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.421018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1055/2107] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:46.423294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:46.434793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1053/2108] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:46.441224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25f2d5-9e82-4ad6-8d6f-c3e44cc562b4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:46.446886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.447887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.448246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.448598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.449509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.451286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.464578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1056/2109] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:46.468947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:46.481321 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd1e8-b2cd-464d-8dc4-9f4ba5e19fda service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:46.489408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c99de-ab00-4218-a7ec-6c04edb96a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.489907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c99de-ab00-4218-a7ec-6c04edb96a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.490406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c99de-ab00-4218-a7ec-6c04edb96a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.490664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c99de-ab00-4218-a7ec-6c04edb96a1c admin admin] PATH_INFO: `/v3/projects/cca58db851fa46a89a2943dd3d09bc79/users/4ccdb7ca094745f9ac1e595b96ab4e2a/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.514103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c99de-ab00-4218-a7ec-6c04edb96a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca58db851fa46a89a2943dd3d09bc79, user_id=4ccdb7ca094745f9ac1e595b96ab4e2a, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.517157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c99de-ab00-4218-a7ec-6c04edb96a1c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.558636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:46.558636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:46.573874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818038-d95d-4127-a9b6-c14d2bfadfcb admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:46.579279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.580157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.580608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.580899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] PATH_INFO: `/v3/projects/b84df8843b0a49c09b644a097296a961` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.582222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84df8843b0a49c09b644a097296a961)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.584169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.658255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1054/2110] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:46 2022] PUT /identity/v3/projects/cca58db851fa46a89a2943dd3d09bc79/users/4ccdb7ca094745f9ac1e595b96ab4e2a/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:46.669943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1a84-6077-4908-b572-1161757c4257 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.670318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1a84-6077-4908-b572-1161757c4257 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.670597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1a84-6077-4908-b572-1161757c4257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.702517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-599c1a84-6077-4908-b572-1161757c4257 None None] MFA Rules not processed for user `4ccdb7ca094745f9ac1e595b96ab4e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:46.703753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-599c1a84-6077-4908-b572-1161757c4257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:46.779221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1055/2111] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:46.784404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c1a84-6077-4908-b572-1161757c4257 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:46.792101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84df8843b0a49c09b644a097296a961', 'request_id': 'req-35cb39d7-a755-42e3-ac54-1cbeac870638'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:46.897676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c1a84-6077-4908-b572-1161757c4257 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:46.928015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84df8843b0a49c09b644a097296a961', 'request_id': 'req-35cb39d7-a755-42e3-ac54-1cbeac870638'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:46.937805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84df8843b0a49c09b644a097296a961', 'request_id': 'req-35cb39d7-a755-42e3-ac54-1cbeac870638'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:46.961774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] The token cache is being invalidate because project b84df8843b0a49c09b644a097296a961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:46.962081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:46.963039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-35cb39d7-a755-42e3-ac54-1cbeac870638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:46.965024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1057/2112] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:46 2022] DELETE /identity/v3/projects/b84df8843b0a49c09b644a097296a961 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:46.972672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b831-5618-4cb6-8bc8-7b913e58a05a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.973084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b831-5618-4cb6-8bc8-7b913e58a05a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.973288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b831-5618-4cb6-8bc8-7b913e58a05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.984614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:46.990458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:46.990458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:46.990458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:46.991436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:46.993981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:46.997029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a655b831-5618-4cb6-8bc8-7b913e58a05a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:46.998300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a655b831-5618-4cb6-8bc8-7b913e58a05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:47.016700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1058/2113] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:47.020711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98060c76-b430-4ddf-97b6-1d99fa014587 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.020711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98060c76-b430-4ddf-97b6-1d99fa014587 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.020711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98060c76-b430-4ddf-97b6-1d99fa014587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.044003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-98060c76-b430-4ddf-97b6-1d99fa014587 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:47.045378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-98060c76-b430-4ddf-97b6-1d99fa014587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:47.054152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1059/2114] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:47.060077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98060c76-b430-4ddf-97b6-1d99fa014587 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.070250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98060c76-b430-4ddf-97b6-1d99fa014587 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.076570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.076570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.076814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.077031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.077827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:47.078117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.079885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.094345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1060/2115] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:47.098965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.110537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891783e7-8918-49d5-ac5f-8b217fb1588a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.115707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.116469 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.116757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.117041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.117755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.119758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.185532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1056/2116] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:46 2022] POST /identity/v3/projects => generated 381 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:47.191941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.193935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:47.229385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1061/2117] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:47 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:47.236078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.278451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d9b77-cb1c-4765-8eda-5c9dd725887a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.321766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6c308-ec5d-4cab-99c7-760902935b39 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.327852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.328917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.329342 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.329726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.330529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.332949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.348630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.349295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.349580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.349858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.350607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.353120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.533031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1062/2118] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:47 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:47.538408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.543311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1057/2119] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:47 2022] POST /identity/v3/users => generated 297 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:47.544356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.559480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a73e-c97f-48e6-bbe6-e587d97e5f3b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.560971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75bb1-972a-4226-bf42-211e9c47bf41 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.567707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.568893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.569295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.570782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.572281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.575584 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.589603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.594008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.594316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.594605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.595799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.599766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.617245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1063/2120] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:47.619037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.647194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1d96-6001-4db3-8e67-66b36b172871 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.649855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1058/2121] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:47.654655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.661462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.662358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.662871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.663410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.664234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.666770 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.668969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a37ae-2fff-417d-82c9-7468efe17f83 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.675585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54bc3-0c12-44d1-8f52-32241ab3d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.676917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54bc3-0c12-44d1-8f52-32241ab3d5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.677545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54bc3-0c12-44d1-8f52-32241ab3d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.678167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54bc3-0c12-44d1-8f52-32241ab3d5f4 admin admin] PATH_INFO: `/v3/projects/0744267a527f40008bec144bf1e76929/users/16a10ba9feaf46bd82aa2042429e635b/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.691504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1064/2122] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:31:47.695956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.705461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54bc3-0c12-44d1-8f52-32241ab3d5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0744267a527f40008bec144bf1e76929, user_id=16a10ba9feaf46bd82aa2042429e635b, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.709858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54bc3-0c12-44d1-8f52-32241ab3d5f4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.719556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944cd77-8ef9-4a69-b2de-6f2766234d7b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:47.728062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:47.732644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.732644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.732644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] PATH_INFO: `/v3/projects/e162e0e73a1348adb49fb5aa28ad364e/users/b4f3c1d17bb04a9aacdc6c24e7153666/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.762362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e162e0e73a1348adb49fb5aa28ad364e, user_id=b4f3c1d17bb04a9aacdc6c24e7153666, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:47.765430 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:47.877920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1065/2123] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:47 2022] PUT /identity/v3/projects/e162e0e73a1348adb49fb5aa28ad364e/users/b4f3c1d17bb04a9aacdc6c24e7153666/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:47.881785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1059/2124] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:47 2022] PUT /identity/v3/projects/0744267a527f40008bec144bf1e76929/users/16a10ba9feaf46bd82aa2042429e635b/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:47.883073 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:47.892775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:47.893124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:47.893396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:47.952539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] MFA Rules not processed for user `b4f3c1d17bb04a9aacdc6c24e7153666`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:47.955576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:48.001181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e3ce4-1d46-4516-86e9-75fb7e2f1f2e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:48.009636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:48.011055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.011668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.012211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:48.013618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:48.024420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:48.048968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1066/2125] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:48.050831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:48.068094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fcb15-fb73-4e0c-ae18-11472981bf4a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:48.076760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5811ad-7b5a-4678-9a58-a6569ddf5623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:48.077743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5811ad-7b5a-4678-9a58-a6569ddf5623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.078179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5811ad-7b5a-4678-9a58-a6569ddf5623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.078515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5811ad-7b5a-4678-9a58-a6569ddf5623 admin admin] PATH_INFO: `/v3/projects/0744267a527f40008bec144bf1e76929/users/16a10ba9feaf46bd82aa2042429e635b/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:48.080816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5811ad-7b5a-4678-9a58-a6569ddf5623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0744267a527f40008bec144bf1e76929, user_id=16a10ba9feaf46bd82aa2042429e635b, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:48.083726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5811ad-7b5a-4678-9a58-a6569ddf5623 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:48.098583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1060/2126] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:48.101099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1067/2127] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:48 2022] PUT /identity/v3/projects/0744267a527f40008bec144bf1e76929/users/16a10ba9feaf46bd82aa2042429e635b/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:48.112710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:48.113477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.113836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.113933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:48.114360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:48.156374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] MFA Rules not processed for user `16a10ba9feaf46bd82aa2042429e635b`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:48.157906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:48.200520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792c77-2fe9-418c-b862-40264795e364 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:48.287040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1068/2128] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:48.324126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:48.325010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.325352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.325706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:48.394065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:48.395568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:48.408138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1061/2129] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:48.487307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:48.493438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:48.509575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55611-14bd-4f87-827d-c78184e99c37 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:48.515906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:48.517127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.517771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.518381 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:48.530272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:48.532782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:48.553239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1069/2130] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:48.647394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:48.649238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:48.743710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc17495-bb20-4180-bc27-d5db05b549dc service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:48.750353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:48.751235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.751664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.752011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] PATH_INFO: `/v3/users/fcee7eaf1cfb441c91b35a6c45cff5fe` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:48.753597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcee7eaf1cfb441c91b35a6c45cff5fe)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:48.755893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:48.798958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:48.809334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a091-641d-4cc2-959e-23b6323209ce service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:48.814100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13bb14-385c-4c46-80be-3e05b83ec728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:48.814870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13bb14-385c-4c46-80be-3e05b83ec728 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.815133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13bb14-385c-4c46-80be-3e05b83ec728 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.815406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13bb14-385c-4c46-80be-3e05b83ec728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:48.822826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5c13bb14-385c-4c46-80be-3e05b83ec728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:48.950453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13bb14-385c-4c46-80be-3e05b83ec728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:48.954536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13bb14-385c-4c46-80be-3e05b83ec728 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:48.966807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1070/2131] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:49.048124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:49.093113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcee7eaf1cfb441c91b35a6c45cff5fe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:49.093113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcee7eaf1cfb441c91b35a6c45cff5fe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:49.093113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcee7eaf1cfb441c91b35a6c45cff5fe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:49.419391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcee7eaf1cfb441c91b35a6c45cff5fe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:49.422126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcee7eaf1cfb441c91b35a6c45cff5fe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:49.445192 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1062/2132] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:48 2022] DELETE /identity/v3/users/fcee7eaf1cfb441c91b35a6c45cff5fe => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:49.447219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:49.447727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:49.448075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:49.486362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:49.488281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:49.646833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1071/2133] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:49.669222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:49.686162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:49.842758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd6ad-c1d6-4a68-8f0d-784a8de1ebad admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:49.859653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3472be5-c1f3-46da-a4f3-e245be62c15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:49.860381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3472be5-c1f3-46da-a4f3-e245be62c15d service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:49.860736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3472be5-c1f3-46da-a4f3-e245be62c15d service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:49.861107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3472be5-c1f3-46da-a4f3-e245be62c15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:49.877185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3472be5-c1f3-46da-a4f3-e245be62c15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:49.878861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3472be5-c1f3-46da-a4f3-e245be62c15d service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:49.891495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1063/2134] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:50.245545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:50.253233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:50.275316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169cb8e-52ba-4792-8ff9-6a75a13e3058 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:50.280224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:50.280912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:50.281259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:50.286241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] PATH_INFO: `/v3/users/4ccdb7ca094745f9ac1e595b96ab4e2a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:50.286241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccdb7ca094745f9ac1e595b96ab4e2a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:50.286241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:50.588404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccdb7ca094745f9ac1e595b96ab4e2a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:50.607062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccdb7ca094745f9ac1e595b96ab4e2a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:50.608071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccdb7ca094745f9ac1e595b96ab4e2a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:50.616240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccdb7ca094745f9ac1e595b96ab4e2a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:50.747180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccdb7ca094745f9ac1e595b96ab4e2a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:50.748346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:50.755658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1072/2135] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:50 2022] DELETE /identity/v3/users/4ccdb7ca094745f9ac1e595b96ab4e2a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:50.761050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:50.761485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:50.761776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:50.784555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:50.786144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:50.877419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:50.879309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:50.888495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1064/2136] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:50.895610 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318583-6cc2-446f-be6f-873c77313879 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:50.902366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:50.904003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:50.922836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:50.923944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:50.924373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:50.924894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] PATH_INFO: `/v3/projects/bd093d5a16114cc3a180a8713e1fe9c9` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:50.928011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd093d5a16114cc3a180a8713e1fe9c9)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:50.930847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:51.011273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1860cf-92ef-482c-8ede-795e144619c5 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:51.024340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:51.024943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:51.026199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:51.028816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:51.062410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:51.066161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:51.105249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1065/2137] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:51.168220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd093d5a16114cc3a180a8713e1fe9c9', 'request_id': 'req-ae95f5a3-af8b-475a-983a-16aae6fd99de'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.319642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd093d5a16114cc3a180a8713e1fe9c9', 'request_id': 'req-ae95f5a3-af8b-475a-983a-16aae6fd99de'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.333752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd093d5a16114cc3a180a8713e1fe9c9', 'request_id': 'req-ae95f5a3-af8b-475a-983a-16aae6fd99de'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.402106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] The token cache is being invalidate because project bd093d5a16114cc3a180a8713e1fe9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:51.403621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.405095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.409368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1073/2138] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:50 2022] DELETE /identity/v3/projects/bd093d5a16114cc3a180a8713e1fe9c9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:51.413473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:51.433540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7452c9-6761-4c10-ab13-c020866fc6b8 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:51.518252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:51.519909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:51.520477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:51.521021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] PATH_INFO: `/v3/users/f0144796f3744a20a45e38570ad08b28` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:51.522737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0144796f3744a20a45e38570ad08b28)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:51.526380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:51.824647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0144796f3744a20a45e38570ad08b28'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.841080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0144796f3744a20a45e38570ad08b28'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.849546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0144796f3744a20a45e38570ad08b28'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.980242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0144796f3744a20a45e38570ad08b28'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.981226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0144796f3744a20a45e38570ad08b28'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:51.999830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1066/2139] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:51 2022] DELETE /identity/v3/users/f0144796f3744a20a45e38570ad08b28 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:52.497183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:52.500281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:52.522172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f5a3-af8b-475a-983a-16aae6fd99de admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:52.645467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:52.645467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:52.646013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:52.646812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] PATH_INFO: `/v3/projects/cca58db851fa46a89a2943dd3d09bc79` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:52.649624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca58db851fa46a89a2943dd3d09bc79)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:52.654099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:52.755669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:52.762796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:52.783844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf80f9-2247-47d4-b1f2-896e773434f7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:52.792011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:52.793499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:52.793499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:52.793499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] PATH_INFO: `/v3/projects/a2dbfe95547248e7af158e46c79a1fca` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:52.795790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2dbfe95547248e7af158e46c79a1fca)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:52.801407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:52.834534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca58db851fa46a89a2943dd3d09bc79', 'request_id': 'req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:52.875750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:52.971697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca58db851fa46a89a2943dd3d09bc79', 'request_id': 'req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:52.981419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca58db851fa46a89a2943dd3d09bc79', 'request_id': 'req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:52.995059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2dbfe95547248e7af158e46c79a1fca', 'request_id': 'req-45dbf4df-505e-4e80-ba39-ed4e39a231ee'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:52.997799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] The token cache is being invalidate because project cca58db851fa46a89a2943dd3d09bc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:52.998481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:52.999719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.002136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1074/2140] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:52 2022] DELETE /identity/v3/projects/cca58db851fa46a89a2943dd3d09bc79 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:53.005317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2dbfe95547248e7af158e46c79a1fca', 'request_id': 'req-45dbf4df-505e-4e80-ba39-ed4e39a231ee'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.006369 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:53.008952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:53.021622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2dbfe95547248e7af158e46c79a1fca', 'request_id': 'req-45dbf4df-505e-4e80-ba39-ed4e39a231ee'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.108001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa4fa-2aaf-45d2-92a3-2cac6938bb04 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:53.171758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] The token cache is being invalidate because project a2dbfe95547248e7af158e46c79a1fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:53.172675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.173993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45dbf4df-505e-4e80-ba39-ed4e39a231ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.182062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1067/2141] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:52 2022] DELETE /identity/v3/projects/a2dbfe95547248e7af158e46c79a1fca => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:53.184856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a855c-30f9-495e-a50a-ee6c2138d856 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:53.185610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a855c-30f9-495e-a50a-ee6c2138d856 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:53.186206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a855c-30f9-495e-a50a-ee6c2138d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:53.198641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:53.199394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:53.203708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:53.203708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] PATH_INFO: `/v3/users/16a10ba9feaf46bd82aa2042429e635b` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:53.203708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a10ba9feaf46bd82aa2042429e635b)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:53.205397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:53.220832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-251a855c-30f9-495e-a50a-ee6c2138d856 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:53.222849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-251a855c-30f9-495e-a50a-ee6c2138d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:53.235325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1068/2142] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:53.244499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58c3c4-6d06-47ef-a5e8-6e64d154a5f7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:53.245031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58c3c4-6d06-47ef-a5e8-6e64d154a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:53.245562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58c3c4-6d06-47ef-a5e8-6e64d154a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:53.293743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ab58c3c4-6d06-47ef-a5e8-6e64d154a5f7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:53.295051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ab58c3c4-6d06-47ef-a5e8-6e64d154a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:53.319861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1069/2143] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:53.327206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58c3c4-6d06-47ef-a5e8-6e64d154a5f7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:53.344058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58c3c4-6d06-47ef-a5e8-6e64d154a5f7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:53.364859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:53.365821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:53.366325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:53.366780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:53.371250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:53.371797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:53.375589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:53.402428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1070/2144] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:31:53.407987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:53.425766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a1e05-3394-43ae-a96f-f34b7cca25b4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:53.435292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:53.435925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:53.436614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:53.437188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:53.437842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:53.440070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:53.560976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1071/2145] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:53 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:53.563840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a10ba9feaf46bd82aa2042429e635b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.568143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:53.580341 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a10ba9feaf46bd82aa2042429e635b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.582020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a10ba9feaf46bd82aa2042429e635b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.591929 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a10ba9feaf46bd82aa2042429e635b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.684973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160c2b6-6a7b-4cbb-a0a4-b2b6e2352b30 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:53.690566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:53.691124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:53.691405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:53.691680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:53.692327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:53.694358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:53.705089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a10ba9feaf46bd82aa2042429e635b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:53.722015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1075/2146] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:53 2022] DELETE /identity/v3/users/16a10ba9feaf46bd82aa2042429e635b => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:31:53.863390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1072/2147] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:53 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:53.868502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:53.870715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:54.038206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bf28-7b99-4a3b-9297-2dd05c1d1232 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:54.046242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:54.047551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:54.048170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:54.048681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:54.049847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:54.052466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:54.068950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1076/2148] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:54.074388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:54.085707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16cfa7-5ae2-4940-a51b-2e80fa80cdfd admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:54.091610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1844b8-7a18-4f32-8347-e5e8aa808357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:54.092232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1844b8-7a18-4f32-8347-e5e8aa808357 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:54.092512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1844b8-7a18-4f32-8347-e5e8aa808357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:54.092783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1844b8-7a18-4f32-8347-e5e8aa808357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:54.093507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1844b8-7a18-4f32-8347-e5e8aa808357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:54.095191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1844b8-7a18-4f32-8347-e5e8aa808357 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:54.107999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1073/2149] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:54.112622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:54.124622 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406735-d3e2-47fd-9c94-919a0d128f85 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:54.129958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:54.130301 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:54.130680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:54.130965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] PATH_INFO: `/v3/projects/1d3d9b399ad34c4f97fb3cab80db8785/users/b89a763f09a5418db21bc42ccf9214cb/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:54.151058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3d9b399ad34c4f97fb3cab80db8785, user_id=b89a763f09a5418db21bc42ccf9214cb, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:54.153855 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:54.317214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1077/2150] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:54 2022] PUT /identity/v3/projects/1d3d9b399ad34c4f97fb3cab80db8785/users/b89a763f09a5418db21bc42ccf9214cb/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:54.326967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:54.327279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:54.327510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:54.378682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] MFA Rules not processed for user `b89a763f09a5418db21bc42ccf9214cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:54.381411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:54.442784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:54.448177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:54.577555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1074/2151] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:54.591511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:54.595852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:54.612191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55837-07f5-4cbc-a114-ef61eb26ab97 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:54.622183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:54.622833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:54.623278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:54.623722 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] PATH_INFO: `/v3/projects/0744267a527f40008bec144bf1e76929` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:54.625288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0744267a527f40008bec144bf1e76929)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:54.641138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:54.700011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aea88-b6dd-4407-9f63-2aca2aafccbb None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:54.700964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57909da-d128-45ca-9440-04824175e2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:54.701706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57909da-d128-45ca-9440-04824175e2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:54.702124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57909da-d128-45ca-9440-04824175e2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:54.702583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57909da-d128-45ca-9440-04824175e2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:54.715821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57909da-d128-45ca-9440-04824175e2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:54.716920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57909da-d128-45ca-9440-04824175e2b6 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:54.730133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1075/2152] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:55.018227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0744267a527f40008bec144bf1e76929', 'request_id': 'req-ecf5e273-5416-4186-9fc5-8708e06c1920'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:55.249903 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0744267a527f40008bec144bf1e76929', 'request_id': 'req-ecf5e273-5416-4186-9fc5-8708e06c1920'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:55.264899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0744267a527f40008bec144bf1e76929', 'request_id': 'req-ecf5e273-5416-4186-9fc5-8708e06c1920'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:55.292817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] The token cache is being invalidate because project 0744267a527f40008bec144bf1e76929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:31:55.294465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:55.296800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-ecf5e273-5416-4186-9fc5-8708e06c1920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:55.312223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1078/2153] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:54 2022] DELETE /identity/v3/projects/0744267a527f40008bec144bf1e76929 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:55.316503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ccbe-c9d0-4650-a9c1-4c2b2e23f056 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:55.317916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ccbe-c9d0-4650-a9c1-4c2b2e23f056 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:55.318449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ccbe-c9d0-4650-a9c1-4c2b2e23f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:55.364662 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-6c34ccbe-c9d0-4650-a9c1-4c2b2e23f056 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:55.382104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6c34ccbe-c9d0-4650-a9c1-4c2b2e23f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:55.516895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1076/2154] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:55.533804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553761-ca89-4c9a-ad8e-fc57d4347cb1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:55.534385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553761-ca89-4c9a-ad8e-fc57d4347cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:55.534944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553761-ca89-4c9a-ad8e-fc57d4347cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:55.568160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-98553761-ca89-4c9a-ad8e-fc57d4347cb1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:55.569139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-98553761-ca89-4c9a-ad8e-fc57d4347cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:55.586892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1079/2155] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:55.593649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34ccbe-c9d0-4650-a9c1-4c2b2e23f056 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:55.612684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34ccbe-c9d0-4650-a9c1-4c2b2e23f056 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:55.620611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:55.625231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:55.625231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:55.625231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:55.625231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:31:55.625231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:55.629004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:55.649054 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1077/2156] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:55.656125 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98553761-ca89-4c9a-ad8e-fc57d4347cb1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:55.677659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98553761-ca89-4c9a-ad8e-fc57d4347cb1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:55.684840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:55.686226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:55.686902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:55.687442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:55.688343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:55.691677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:55.867036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1080/2157] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:31:55 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:31:55.871655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:55.888095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128cc56-e19c-478d-9e63-13e739b93ab9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:56.081580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:56.082605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:56.082994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:56.083408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:56.084474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:56.088540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:56.293701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:56.301782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1078/2158] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:31:55 2022] POST /identity/v3/users => generated 287 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:31:56.307663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:56.361030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4fedf-be1f-49e9-9a95-99fe66557c85 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:56.409962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:56.410615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:56.410896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:56.411179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:56.411867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:56.413800 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:56.445641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1081/2159] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:56.450658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:56.468272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fbe24-606e-4bab-9763-864b10ddbe41 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:56.500568 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f6feb-ba28-46b7-b6ec-1b891f2499ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:56.501678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f6feb-ba28-46b7-b6ec-1b891f2499ee admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:56.502766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f6feb-ba28-46b7-b6ec-1b891f2499ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:56.503708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f6feb-ba28-46b7-b6ec-1b891f2499ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:56.504514 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f6feb-ba28-46b7-b6ec-1b891f2499ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:56.516380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f6feb-ba28-46b7-b6ec-1b891f2499ee admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:56.549654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1079/2160] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:31:56.550860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:56.573551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310caf-1239-478c-8fa1-ac2002edbf96 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:56.582629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebe3ca-2020-4015-8069-e74b555a2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:56.583734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe3ca-2020-4015-8069-e74b555a2633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:56.584497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe3ca-2020-4015-8069-e74b555a2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:56.584992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe3ca-2020-4015-8069-e74b555a2633 admin admin] PATH_INFO: `/v3/projects/31bc1b78925e430d8ddc94b2e5f24ed3/users/95ae2daab75c4440920722fc290db184/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:56.616164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:56.635261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebe3ca-2020-4015-8069-e74b555a2633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bc1b78925e430d8ddc94b2e5f24ed3, user_id=95ae2daab75c4440920722fc290db184, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:56.647725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebe3ca-2020-4015-8069-e74b555a2633 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:56.840980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1082/2161] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:31:56 2022] PUT /identity/v3/projects/31bc1b78925e430d8ddc94b2e5f24ed3/users/95ae2daab75c4440920722fc290db184/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:56.858415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:56.859541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:56.862503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:56.973309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] MFA Rules not processed for user `95ae2daab75c4440920722fc290db184`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:56.975578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:57.052289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:57.053260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:57.054160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:57.113915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] MFA Rules not processed for user `3383f068af3f4509b781b77a6b56da7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:57.116826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:57.141740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1080/2162] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:57.173515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:57.177846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:57.300317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1083/2163] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:57.319867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:57.329647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:57.406263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9d2fa-5cfd-4fbe-aebb-e63d69a832d1 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:57.414904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:57.416304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:57.416988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:57.417487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:57.439960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:57.439960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:57.462785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1081/2164] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:57.543180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:57.600100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a331939-fde8-444d-a075-d1a72f5d6e45 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:57.625408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485b8fd-d68f-4c03-8a40-d29fa140492d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:57.627996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b8fd-d68f-4c03-8a40-d29fa140492d service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:57.628989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b8fd-d68f-4c03-8a40-d29fa140492d service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:57.629973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b8fd-d68f-4c03-8a40-d29fa140492d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:57.655237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485b8fd-d68f-4c03-8a40-d29fa140492d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:57.658667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485b8fd-d68f-4c03-8a40-d29fa140492d service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:57.679196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1084/2165] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:57.731450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e684ef-c4db-4db7-90b3-1285aa48f9da service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:57.743420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:57.744759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:57.745403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:57.746002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] PATH_INFO: `/v3/users/95ae2daab75c4440920722fc290db184` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:57.748681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ae2daab75c4440920722fc290db184)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:57.753145 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:58.181779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:58.245769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ae2daab75c4440920722fc290db184'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:58.289733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ae2daab75c4440920722fc290db184'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:58.317570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ae2daab75c4440920722fc290db184'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:58.568415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ae2daab75c4440920722fc290db184'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:58.569995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ae2daab75c4440920722fc290db184'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:31:58.577884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1082/2166] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:31:57 2022] DELETE /identity/v3/users/95ae2daab75c4440920722fc290db184 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:31:58.583325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:58.585946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:58.585946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:58.606650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:58.608985 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:58.722516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1085/2167] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:58.730107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:58.731651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:58.884448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74ede2-1b8a-46ed-8a4d-5862607011ae admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:58.906348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:58.908041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:58.911069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:58.911613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:58.937320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:58.941096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:58.969472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1083/2168] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:59.850886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:59.850886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:59.865366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82a56f-515a-44e2-b529-d476e18f878a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:59.871968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:59.872726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:59.873316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:59.873660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] PATH_INFO: `/v3/projects/31bc1b78925e430d8ddc94b2e5f24ed3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:59.875086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bc1b78925e430d8ddc94b2e5f24ed3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:59.877857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:00.041257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bc1b78925e430d8ddc94b2e5f24ed3', 'request_id': 'req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:00.181412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:00.184117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bc1b78925e430d8ddc94b2e5f24ed3', 'request_id': 'req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:00.199677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bc1b78925e430d8ddc94b2e5f24ed3', 'request_id': 'req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:00.217147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] The token cache is being invalidate because project 31bc1b78925e430d8ddc94b2e5f24ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:00.217450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:00.218376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9bd3e429-9a67-43d2-bda8-b01eb5b632f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:00.220670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1086/2169] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:31:59 2022] DELETE /identity/v3/projects/31bc1b78925e430d8ddc94b2e5f24ed3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:00.846007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:00.849708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:00.875438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91684bd-8dec-46d6-8489-47968a34b3bc service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:01.009179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:01.009988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:01.010370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:01.010940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] PATH_INFO: `/v3/users/b4f3c1d17bb04a9aacdc6c24e7153666` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:01.012640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f3c1d17bb04a9aacdc6c24e7153666)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:01.014988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:01.397009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f3c1d17bb04a9aacdc6c24e7153666'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:01.422171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f3c1d17bb04a9aacdc6c24e7153666'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:01.437385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f3c1d17bb04a9aacdc6c24e7153666'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:01.592566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f3c1d17bb04a9aacdc6c24e7153666'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:01.593621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f3c1d17bb04a9aacdc6c24e7153666'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:01.605989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1084/2170] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:00 2022] DELETE /identity/v3/users/b4f3c1d17bb04a9aacdc6c24e7153666 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:01.613943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2507d15-4416-4b75-8c77-1b3744352c44 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:01.614813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2507d15-4416-4b75-8c77-1b3744352c44 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:01.614813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2507d15-4416-4b75-8c77-1b3744352c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:01.649334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c2507d15-4416-4b75-8c77-1b3744352c44 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:01.654395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c2507d15-4416-4b75-8c77-1b3744352c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:01.751067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:01.791245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1087/2171] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:01.796970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:01.798936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:01.904433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a35d40-c016-4f5e-86b1-7bdc5e503ca2 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:01.912402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:01.913630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:01.913919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:01.914725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:01.925645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80b75-7440-4942-92c9-42c1beb3cc54 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:01.925850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80b75-7440-4942-92c9-42c1beb3cc54 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:01.926269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80b75-7440-4942-92c9-42c1beb3cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:01.942003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:01.943585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:01.975831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7db80b75-7440-4942-92c9-42c1beb3cc54 None None] MFA Rules not processed for user `3383f068af3f4509b781b77a6b56da7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:01.979472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7db80b75-7440-4942-92c9-42c1beb3cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:02.006355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1085/2172] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:02.180928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1088/2173] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:02.271346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:03.184971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:03.187167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:03.201548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b614d-db99-4a4d-bd7e-f9f66b80184f service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:03.207156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:03.207482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:03.208427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:03.209074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] PATH_INFO: `/v3/projects/e162e0e73a1348adb49fb5aa28ad364e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:03.211242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e162e0e73a1348adb49fb5aa28ad364e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:03.213985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:03.349870 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e162e0e73a1348adb49fb5aa28ad364e', 'request_id': 'req-a96b18ad-885c-49a0-a880-7fcf9228500d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:03.357918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e162e0e73a1348adb49fb5aa28ad364e', 'request_id': 'req-a96b18ad-885c-49a0-a880-7fcf9228500d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:03.366473 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e162e0e73a1348adb49fb5aa28ad364e', 'request_id': 'req-a96b18ad-885c-49a0-a880-7fcf9228500d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:03.571039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] The token cache is being invalidate because project e162e0e73a1348adb49fb5aa28ad364e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:03.573847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:03.573847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a96b18ad-885c-49a0-a880-7fcf9228500d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:03.575672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1086/2174] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:03 2022] DELETE /identity/v3/projects/e162e0e73a1348adb49fb5aa28ad364e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:03.581600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c8929-09bb-456a-b493-758d03283275 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:03.583128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c8929-09bb-456a-b493-758d03283275 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:03.583481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c8929-09bb-456a-b493-758d03283275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:03.623886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4a6c8929-09bb-456a-b493-758d03283275 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:03.626163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4a6c8929-09bb-456a-b493-758d03283275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:03.720392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1089/2175] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:03.735094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98329fef-6fd4-4fdf-90f4-3ea574afa58b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:03.735612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98329fef-6fd4-4fdf-90f4-3ea574afa58b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:03.736079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98329fef-6fd4-4fdf-90f4-3ea574afa58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:03.767815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-98329fef-6fd4-4fdf-90f4-3ea574afa58b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:03.769959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-98329fef-6fd4-4fdf-90f4-3ea574afa58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:03.785816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1087/2176] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:03.791178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c8929-09bb-456a-b493-758d03283275 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:03.801831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c8929-09bb-456a-b493-758d03283275 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:03.806944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:03.808105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:03.808309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:03.808581 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:03.809323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:03.809625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:03.811403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:03.825842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1090/2177] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:03.831535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98329fef-6fd4-4fdf-90f4-3ea574afa58b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:03.848195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98329fef-6fd4-4fdf-90f4-3ea574afa58b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:03.855587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:03.856535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:03.857687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:03.858264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:03.858896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:03.861263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:04.095511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1088/2178] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:32:03 2022] POST /identity/v3/projects => generated 359 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:04.096404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:04.108355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3983307-93b4-473b-9071-2c2ef25c6f30 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:04.201942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:04.202572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:04.202857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:04.203132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:04.204459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:04.207312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:04.360902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1091/2179] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:32:04 2022] POST /identity/v3/users => generated 280 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:32:04.367022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:04.388587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db27cd-1e88-4c9e-bf24-b3cf759f1c94 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:04.397683 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:04.398779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:04.399460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:04.399962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:04.401116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:04.404134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:04.424322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1089/2180] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:04.425902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:04.439441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d073d2-341a-43be-a709-94cfaf566952 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:04.459969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb65139-6fb5-42ae-bff4-196e59be7af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:04.461625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb65139-6fb5-42ae-bff4-196e59be7af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:04.462091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb65139-6fb5-42ae-bff4-196e59be7af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:04.462646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb65139-6fb5-42ae-bff4-196e59be7af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:04.463672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb65139-6fb5-42ae-bff4-196e59be7af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:04.469323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb65139-6fb5-42ae-bff4-196e59be7af7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:04.490575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1092/2181] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:04.497269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:04.512768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23b7d9-21dc-46d9-a5c0-e4eacbed0d00 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:04.519519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:04.520453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:04.520871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:04.521382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] PATH_INFO: `/v3/projects/eb223abed181448894cbce4b2f19fb31/users/5c9011d5bb254c31a2acca015ebb0260/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:04.544733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb223abed181448894cbce4b2f19fb31, user_id=5c9011d5bb254c31a2acca015ebb0260, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:04.548857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:04.683944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1090/2182] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:32:04 2022] PUT /identity/v3/projects/eb223abed181448894cbce4b2f19fb31/users/5c9011d5bb254c31a2acca015ebb0260/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:04.701967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a7c3-87fb-48d2-95f2-c15fd5b82285 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:04.702879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a7c3-87fb-48d2-95f2-c15fd5b82285 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:04.702879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a7c3-87fb-48d2-95f2-c15fd5b82285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:04.749663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f1d1a7c3-87fb-48d2-95f2-c15fd5b82285 None None] MFA Rules not processed for user `5c9011d5bb254c31a2acca015ebb0260`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:04.752135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f1d1a7c3-87fb-48d2-95f2-c15fd5b82285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:04.907236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1093/2183] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:04.968440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:04.974781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:05.129733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e301-0a9f-48da-8ef6-033bb97b91ad admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:05.137381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a0ee7-bb0a-45de-8b82-7b33f296f843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:05.138736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0ee7-bb0a-45de-8b82-7b33f296f843 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:05.139479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0ee7-bb0a-45de-8b82-7b33f296f843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:05.140067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0ee7-bb0a-45de-8b82-7b33f296f843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:05.179273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a0ee7-bb0a-45de-8b82-7b33f296f843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:05.191830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a0ee7-bb0a-45de-8b82-7b33f296f843 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:05.217357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1091/2184] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:05.255697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a7c3-87fb-48d2-95f2-c15fd5b82285 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:05.384180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a7c3-87fb-48d2-95f2-c15fd5b82285 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:05.389674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:05.390410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:05.390774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:05.391151 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] PATH_INFO: `/v3/users/5c9011d5bb254c31a2acca015ebb0260` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:05.392634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9011d5bb254c31a2acca015ebb0260)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:05.395005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:05.650439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9011d5bb254c31a2acca015ebb0260'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:05.670707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9011d5bb254c31a2acca015ebb0260'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:05.671677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9011d5bb254c31a2acca015ebb0260'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:05.680066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9011d5bb254c31a2acca015ebb0260'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:05.838665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9011d5bb254c31a2acca015ebb0260'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:05.848019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1094/2185] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:05 2022] DELETE /identity/v3/users/5c9011d5bb254c31a2acca015ebb0260 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:05.855097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:05.855569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:05.855804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:05.880807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:05.882433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:05.948676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1092/2186] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:05.959106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:05.960723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:06.037566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b96f41-b206-4885-bb8b-40ff52e0883a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:06.041859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcac23-f185-4d74-b2f4-efeb04013aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:06.042475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcac23-f185-4d74-b2f4-efeb04013aba service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:06.042753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcac23-f185-4d74-b2f4-efeb04013aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:06.043027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcac23-f185-4d74-b2f4-efeb04013aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:06.053501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcac23-f185-4d74-b2f4-efeb04013aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:06.055765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcac23-f185-4d74-b2f4-efeb04013aba service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:06.068179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1095/2187] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:06.710677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:06.714206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:06.731729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6886-eb6d-4881-a04c-5b6aee4c0034 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:06.746340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:06.747681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:06.748176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:06.748680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] PATH_INFO: `/v3/projects/eb223abed181448894cbce4b2f19fb31` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:06.750374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb223abed181448894cbce4b2f19fb31)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:06.752952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:06.936528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb223abed181448894cbce4b2f19fb31', 'request_id': 'req-7761e035-7812-4584-a63b-5e6beda4eb26'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:06.942552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb223abed181448894cbce4b2f19fb31', 'request_id': 'req-7761e035-7812-4584-a63b-5e6beda4eb26'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:06.949634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb223abed181448894cbce4b2f19fb31', 'request_id': 'req-7761e035-7812-4584-a63b-5e6beda4eb26'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:06.954377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:07.129733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] The token cache is being invalidate because project eb223abed181448894cbce4b2f19fb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:07.129733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:07.134516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:07.142878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f23b98-844b-4bd4-bde5-4c42fb89adfb None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.143432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f23b98-844b-4bd4-bde5-4c42fb89adfb None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.143680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f23b98-844b-4bd4-bde5-4c42fb89adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.144687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1093/2188] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:06 2022] DELETE /identity/v3/projects/eb223abed181448894cbce4b2f19fb31 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:07.171894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-16f23b98-844b-4bd4-bde5-4c42fb89adfb None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:07.174174 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-16f23b98-844b-4bd4-bde5-4c42fb89adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:07.186976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:07.186976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:07.271846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761e035-7812-4584-a63b-5e6beda4eb26 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:07.280116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1096/2189] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:07.280323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:07.282559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.283093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.283639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.284318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:07.288410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db5173-831c-4910-b845-6a094b740111 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.288593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:07.288830 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db5173-831c-4910-b845-6a094b740111 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.290001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db5173-831c-4910-b845-6a094b740111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.319196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c6db5173-831c-4910-b845-6a094b740111 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:07.320737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c6db5173-831c-4910-b845-6a094b740111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:07.333308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1097/2190] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:07.335300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db5173-831c-4910-b845-6a094b740111 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:07.366614 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db5173-831c-4910-b845-6a094b740111 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:07.372884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:07.373913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.374367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.374799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.375696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:07.376155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:07.378165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:07.400801 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1098/2191] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:07.405607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:07.416933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17fa9b-1e10-4706-b416-2a94c76e0f73 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:07.417211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:07.419490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:07.423878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:07.424650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.425037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.425410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.426136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:07.428329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:07.436311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1094/2192] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:32:07.626356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1099/2193] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:32:07 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:32:07.633490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:07.645714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ad570-2de1-47df-9717-99d540e18679 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:07.730926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:07.732304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.732593 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.732882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.733597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:07.735591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:07.853964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1095/2194] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:32:07 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:07.855647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:07.868313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67696466-60a3-4572-bf3c-4c8c3d6b1a96 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:07.873951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:07.875272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.875272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.875543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.876044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:07.877891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:07.896984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1100/2195] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:32:07.899451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:07.911267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91e2d-2c3f-4569-981b-1b9248d81c46 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:07.917185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53846ddd-2620-4d3a-8c61-2fddd1db4947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:07.917496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846ddd-2620-4d3a-8c61-2fddd1db4947 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.917789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846ddd-2620-4d3a-8c61-2fddd1db4947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.918063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846ddd-2620-4d3a-8c61-2fddd1db4947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.918771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53846ddd-2620-4d3a-8c61-2fddd1db4947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:07.920615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53846ddd-2620-4d3a-8c61-2fddd1db4947 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:07.934799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1096/2196] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:07.939487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:07.953404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f44bf-36d7-48b9-83c6-4d638085fdfd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:07.958867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:07.959936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:07.963150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:07.963150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] PATH_INFO: `/v3/projects/26baf92cb67242f0a9dfb108933bd71d/users/e458a1ad21954cf3a58cdc0b6cd10efe/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:07.980263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26baf92cb67242f0a9dfb108933bd71d, user_id=e458a1ad21954cf3a58cdc0b6cd10efe, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:07.983259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:08.099204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1101/2197] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:32:07 2022] PUT /identity/v3/projects/26baf92cb67242f0a9dfb108933bd71d/users/e458a1ad21954cf3a58cdc0b6cd10efe/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:08.111901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214d58-3924-48ca-86d3-28e18fb3cb5e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:08.112547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214d58-3924-48ca-86d3-28e18fb3cb5e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:08.112547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214d58-3924-48ca-86d3-28e18fb3cb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:08.151158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-bf214d58-3924-48ca-86d3-28e18fb3cb5e None None] MFA Rules not processed for user `e458a1ad21954cf3a58cdc0b6cd10efe`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:08.152605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bf214d58-3924-48ca-86d3-28e18fb3cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:08.253425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1097/2198] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:08.445520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:08.445520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:08.516559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d194-2c20-4ced-9d27-387511ccfa14 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:08.520219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e3bc-0a0b-4236-8ca5-e3d8d472b83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:08.520824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e3bc-0a0b-4236-8ca5-e3d8d472b83c service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:08.521136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e3bc-0a0b-4236-8ca5-e3d8d472b83c service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:08.521395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e3bc-0a0b-4236-8ca5-e3d8d472b83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:08.531717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e3bc-0a0b-4236-8ca5-e3d8d472b83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:08.533265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e3bc-0a0b-4236-8ca5-e3d8d472b83c service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:08.544747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1102/2199] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:10.175729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:11.463535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:12.566168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214d58-3924-48ca-86d3-28e18fb3cb5e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:12.666807 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214d58-3924-48ca-86d3-28e18fb3cb5e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:12.672528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:12.673485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:12.675492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:12.675492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] PATH_INFO: `/v3/users/e458a1ad21954cf3a58cdc0b6cd10efe` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:12.675766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e458a1ad21954cf3a58cdc0b6cd10efe)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:12.677846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:12.897309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:12.974589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e458a1ad21954cf3a58cdc0b6cd10efe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:12.994347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e458a1ad21954cf3a58cdc0b6cd10efe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:13.002362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e458a1ad21954cf3a58cdc0b6cd10efe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:13.215272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e458a1ad21954cf3a58cdc0b6cd10efe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:13.216489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e458a1ad21954cf3a58cdc0b6cd10efe'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:13.229791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1098/2200] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:12 2022] DELETE /identity/v3/users/e458a1ad21954cf3a58cdc0b6cd10efe => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:13.237782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:13.237782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:13.238702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:13.267016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:13.268602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:13.343659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1103/2201] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:13.357562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:13.359221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:13.440053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8c81-a469-49d2-8fbd-99dfe4a561b5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:13.444455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba85ff-51f6-467d-9a16-9504b4e3c4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:13.445150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba85ff-51f6-467d-9a16-9504b4e3c4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:13.445459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba85ff-51f6-467d-9a16-9504b4e3c4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:13.445735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba85ff-51f6-467d-9a16-9504b4e3c4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:13.456836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba85ff-51f6-467d-9a16-9504b4e3c4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:13.458326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba85ff-51f6-467d-9a16-9504b4e3c4e6 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:13.471379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1099/2202] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:14.375343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:14.377042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:14.391743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc80787-2a40-41ce-96b9-96827ba04cf2 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:14.397555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:14.398597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:14.399061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:14.399594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] PATH_INFO: `/v3/projects/26baf92cb67242f0a9dfb108933bd71d` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:14.401337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26baf92cb67242f0a9dfb108933bd71d)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:14.403334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:14.593017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26baf92cb67242f0a9dfb108933bd71d', 'request_id': 'req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:14.734210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26baf92cb67242f0a9dfb108933bd71d', 'request_id': 'req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:14.751100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26baf92cb67242f0a9dfb108933bd71d', 'request_id': 'req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:14.816238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] The token cache is being invalidate because project 26baf92cb67242f0a9dfb108933bd71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:14.822676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:14.822676 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:14.832821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1104/2203] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:14 2022] DELETE /identity/v3/projects/26baf92cb67242f0a9dfb108933bd71d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:15.141772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.239282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e2a31-9e22-4b65-945a-07ea103529bf None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:15.239802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e2a31-9e22-4b65-945a-07ea103529bf None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:15.240136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e2a31-9e22-4b65-945a-07ea103529bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:15.263113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-501e2a31-9e22-4b65-945a-07ea103529bf None None] MFA Rules not processed for user `1456c4aeb4b64ec5b81ab2c6df2abbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:15.264349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-501e2a31-9e22-4b65-945a-07ea103529bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:15.350123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1100/2204] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:16.605751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:17.679213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:17.684442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:17.700108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:17.767407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8278cf-7e04-43f1-9ca1-d9fa8e488b85 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:17.772270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:17.772923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:17.773808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:17.774402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] PATH_INFO: `/v3/users/b89a763f09a5418db21bc42ccf9214cb` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:17.775655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89a763f09a5418db21bc42ccf9214cb)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:17.777742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:18.075504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89a763f09a5418db21bc42ccf9214cb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:18.087672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89a763f09a5418db21bc42ccf9214cb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:18.088402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89a763f09a5418db21bc42ccf9214cb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:18.096118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89a763f09a5418db21bc42ccf9214cb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:18.266920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89a763f09a5418db21bc42ccf9214cb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:18.275236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1105/2205] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:17 2022] DELETE /identity/v3/users/b89a763f09a5418db21bc42ccf9214cb => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:18.280219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:18.280676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:18.281211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:18.304248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:18.305729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:18.407094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1101/2206] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:18.419755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:18.421344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:18.507595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306f55c-9abf-47a0-9383-9a662a84e9ca admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:18.512342 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3328ec-2aee-4230-a29d-97af4dfb4091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:18.512958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3328ec-2aee-4230-a29d-97af4dfb4091 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:18.513263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3328ec-2aee-4230-a29d-97af4dfb4091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:18.513554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3328ec-2aee-4230-a29d-97af4dfb4091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:18.523920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3328ec-2aee-4230-a29d-97af4dfb4091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:18.525399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3328ec-2aee-4230-a29d-97af4dfb4091 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:18.536435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1106/2207] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:19.302516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:19.304043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:19.316298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df561a8-d2d4-45c3-868c-4253048442a0 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:19.321265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:19.322401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:19.322689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:19.322960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] PATH_INFO: `/v3/projects/1d3d9b399ad34c4f97fb3cab80db8785` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:19.324143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3d9b399ad34c4f97fb3cab80db8785)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:19.326426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:19.643254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3d9b399ad34c4f97fb3cab80db8785', 'request_id': 'req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:19.649604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3d9b399ad34c4f97fb3cab80db8785', 'request_id': 'req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:19.655914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3d9b399ad34c4f97fb3cab80db8785', 'request_id': 'req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:19.804196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] The token cache is being invalidate because project 1d3d9b399ad34c4f97fb3cab80db8785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:19.804694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:19.805411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c5ea9cf-237b-40a2-a57c-fc19efaa0eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:19.807002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1102/2208] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:19 2022] DELETE /identity/v3/projects/1d3d9b399ad34c4f97fb3cab80db8785 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:19.812264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599324b-9f12-450a-a174-52d67b2f77e2 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:19.812804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599324b-9f12-450a-a174-52d67b2f77e2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:19.813210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599324b-9f12-450a-a174-52d67b2f77e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:19.836566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4599324b-9f12-450a-a174-52d67b2f77e2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:19.837838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4599324b-9f12-450a-a174-52d67b2f77e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:19.929793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1107/2209] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:19.932304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a0a4-13e6-489a-89b8-fff6d4a70d05 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:19.932719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a0a4-13e6-489a-89b8-fff6d4a70d05 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:19.933232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a0a4-13e6-489a-89b8-fff6d4a70d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:19.963579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5029a0a4-13e6-489a-89b8-fff6d4a70d05 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:19.966575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5029a0a4-13e6-489a-89b8-fff6d4a70d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:19.975372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1103/2210] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:19.989099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599324b-9f12-450a-a174-52d67b2f77e2 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:19.993401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599324b-9f12-450a-a174-52d67b2f77e2 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:20.003438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:20.004102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.004386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.004652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.005429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:20.005957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:20.008960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:20.025684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1108/2211] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:20.032536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a0a4-13e6-489a-89b8-fff6d4a70d05 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:20.050710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a0a4-13e6-489a-89b8-fff6d4a70d05 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:20.059427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:20.060376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.060776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.061336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.062543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:20.065655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:20.198532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1104/2212] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:32:20 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:20.199736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:20.211215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd427a-b72e-440f-b8da-77fe911c224d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:20.336103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:20.336747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.337032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.337515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.338241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:20.340141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:20.433327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1109/2213] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:32:20 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:32:20.437415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:20.451136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d83b-45b1-42a1-ab9e-2e4514a744f7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:20.456726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:20.457739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.458026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.467343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.467343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:20.467343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:20.475922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1105/2214] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:20.477740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:20.491495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a471f-e3e1-470d-acdd-5ad6c7da5fda admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:20.497572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27386ac-8028-49d9-a819-5d96d6a86b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:20.498234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27386ac-8028-49d9-a819-5d96d6a86b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.502840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27386ac-8028-49d9-a819-5d96d6a86b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.502840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27386ac-8028-49d9-a819-5d96d6a86b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.502840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27386ac-8028-49d9-a819-5d96d6a86b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:20.502840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27386ac-8028-49d9-a819-5d96d6a86b25 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:20.512616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1110/2215] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:32:20.517083 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:20.527742 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7f3a-e19f-4c76-b3fe-d8526d6281e5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:20.534470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:20.535136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.537240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.537240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] PATH_INFO: `/v3/projects/3bd9020d48884b38b2b5c0b955af14d4/users/b40b66dd064c4b118b083f7170301c86/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.553261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd9020d48884b38b2b5c0b955af14d4, user_id=b40b66dd064c4b118b083f7170301c86, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:20.556086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:20.660869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1106/2216] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:32:20 2022] PUT /identity/v3/projects/3bd9020d48884b38b2b5c0b955af14d4/users/b40b66dd064c4b118b083f7170301c86/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:20.672892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e675c4-dcbe-4cc4-af3f-19359af5cd8f None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.673225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e675c4-dcbe-4cc4-af3f-19359af5cd8f None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.673508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e675c4-dcbe-4cc4-af3f-19359af5cd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.702093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-02e675c4-dcbe-4cc4-af3f-19359af5cd8f None None] MFA Rules not processed for user `b40b66dd064c4b118b083f7170301c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:20.703230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-02e675c4-dcbe-4cc4-af3f-19359af5cd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:20.769710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1111/2217] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:20.781117 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:20.782935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:20.844146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd91cd-255b-47b8-b8ba-59f5ca41dc74 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:20.848927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71981588-06ea-41f7-9a48-aa0b68a2ffe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:20.849704 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981588-06ea-41f7-9a48-aa0b68a2ffe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:20.850013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981588-06ea-41f7-9a48-aa0b68a2ffe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:20.850266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981588-06ea-41f7-9a48-aa0b68a2ffe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:20.860841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71981588-06ea-41f7-9a48-aa0b68a2ffe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:20.862381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71981588-06ea-41f7-9a48-aa0b68a2ffe1 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:20.872523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1107/2218] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:21.472885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:22.501544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:22.770452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:25.471968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:26.036530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:27.391553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e675c4-dcbe-4cc4-af3f-19359af5cd8f None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:27.456987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e675c4-dcbe-4cc4-af3f-19359af5cd8f None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:27.462076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:27.462708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:27.462987 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:27.463259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] PATH_INFO: `/v3/users/b40b66dd064c4b118b083f7170301c86` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:27.464934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40b66dd064c4b118b083f7170301c86)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:27.467201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:27.725960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40b66dd064c4b118b083f7170301c86'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:27.739346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40b66dd064c4b118b083f7170301c86'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:27.740112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40b66dd064c4b118b083f7170301c86'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:27.748747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40b66dd064c4b118b083f7170301c86'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:27.849101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40b66dd064c4b118b083f7170301c86'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:27.855723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1112/2219] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:27 2022] DELETE /identity/v3/users/b40b66dd064c4b118b083f7170301c86 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:27.860450 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:27.867490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:27.867490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:27.881357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:27.882632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:27.949189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1108/2220] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:27.959380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:27.961156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:28.029366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd359fa4-1f59-4f6f-9de1-3197851666c9 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:28.033084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0681d5-6a74-4071-8482-22990b66326e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:28.033702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0681d5-6a74-4071-8482-22990b66326e service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:28.034895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0681d5-6a74-4071-8482-22990b66326e service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:28.034895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0681d5-6a74-4071-8482-22990b66326e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:28.051303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0681d5-6a74-4071-8482-22990b66326e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:28.051303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0681d5-6a74-4071-8482-22990b66326e service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:28.064508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1113/2221] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:28.837048 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:28.838663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:28.851822 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08859cd7-d8da-4d14-b9ea-864a6282ced2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:28.857543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:28.858217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:28.858516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:28.858773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] PATH_INFO: `/v3/projects/3bd9020d48884b38b2b5c0b955af14d4` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:28.860055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd9020d48884b38b2b5c0b955af14d4)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:28.862003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:29.080900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd9020d48884b38b2b5c0b955af14d4', 'request_id': 'req-752a013c-2a0e-42b4-9e88-09c34bf772a2'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:29.091254 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd9020d48884b38b2b5c0b955af14d4', 'request_id': 'req-752a013c-2a0e-42b4-9e88-09c34bf772a2'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:29.100022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd9020d48884b38b2b5c0b955af14d4', 'request_id': 'req-752a013c-2a0e-42b4-9e88-09c34bf772a2'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:29.291631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] The token cache is being invalidate because project 3bd9020d48884b38b2b5c0b955af14d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:29.291936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:29.292581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-752a013c-2a0e-42b4-9e88-09c34bf772a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:29.299372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1109/2222] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:28 2022] DELETE /identity/v3/projects/3bd9020d48884b38b2b5c0b955af14d4 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:29.301040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c1d3-de85-453d-974e-9123268d5269 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:29.301549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c1d3-de85-453d-974e-9123268d5269 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:29.301750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c1d3-de85-453d-974e-9123268d5269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:29.326111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-09d5c1d3-de85-453d-974e-9123268d5269 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:29.327359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-09d5c1d3-de85-453d-974e-9123268d5269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:29.395467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1114/2223] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:29.403988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579b59-e98f-4b1f-97e0-bb261c979516 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:29.411562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579b59-e98f-4b1f-97e0-bb261c979516 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:29.411562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579b59-e98f-4b1f-97e0-bb261c979516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:29.424984 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-34579b59-e98f-4b1f-97e0-bb261c979516 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:29.426229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-34579b59-e98f-4b1f-97e0-bb261c979516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:29.436002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1110/2224] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:29.441115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c1d3-de85-453d-974e-9123268d5269 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:29.457484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c1d3-de85-453d-974e-9123268d5269 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:29.462948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:29.463558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:29.463904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:29.464170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:29.464822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:29.465149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:29.466991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:29.481265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1115/2225] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:29.485636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579b59-e98f-4b1f-97e0-bb261c979516 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:29.498834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579b59-e98f-4b1f-97e0-bb261c979516 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:29.505744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:29.506526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:29.506949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:29.507323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:29.508076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:29.510955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:29.646809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1111/2226] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:29.653324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:29.665327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ac334-a2fe-48b0-a3f7-4d6cc56ce419 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:29.768194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:29.768420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:29.768716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:29.769081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:29.770029 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:29.772239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:30.003379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1116/2227] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:32:29 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:30.015968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:30.027636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560610c-73ea-4f05-954d-c1f0b1b4c352 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:30.032507 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:30.033207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:30.033491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:30.033766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:30.034492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:30.036178 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:30.047947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1112/2228] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:30.052343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:30.063529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c3af0-2d67-4449-bd05-333081ef7ffe admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:30.068213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78873f56-3fb8-4c17-817c-07fb59423990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:30.068825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873f56-3fb8-4c17-817c-07fb59423990 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:30.069166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873f56-3fb8-4c17-817c-07fb59423990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:30.069411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873f56-3fb8-4c17-817c-07fb59423990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:30.070205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78873f56-3fb8-4c17-817c-07fb59423990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:30.071721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78873f56-3fb8-4c17-817c-07fb59423990 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:30.085988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1117/2229] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:30.101577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:30.113021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6862-9b4c-484d-9318-f6be750f680d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:30.117747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:30.118406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:30.118687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:30.118957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] PATH_INFO: `/v3/projects/c7f904fecd234c8989b35a2d308577d1/users/e3591e1e6c834269b13aa30c027cdc02/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:30.138325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f904fecd234c8989b35a2d308577d1, user_id=e3591e1e6c834269b13aa30c027cdc02, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:30.141029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:30.304222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1113/2230] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:32:30 2022] PUT /identity/v3/projects/c7f904fecd234c8989b35a2d308577d1/users/e3591e1e6c834269b13aa30c027cdc02/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:30.309890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc08f-ce71-4b0c-b25f-93a34ce61c84 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:30.310471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc08f-ce71-4b0c-b25f-93a34ce61c84 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:30.310636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc08f-ce71-4b0c-b25f-93a34ce61c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:30.350455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ae4fc08f-ce71-4b0c-b25f-93a34ce61c84 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:30.353375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ae4fc08f-ce71-4b0c-b25f-93a34ce61c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:30.442689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1118/2231] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:30.454989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:30.456576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:30.527094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cf88b-70be-411c-960a-7d7d5362676e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:30.531071 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde18592-3689-43d2-9b9a-fcdebc640b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:30.531687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18592-3689-43d2-9b9a-fcdebc640b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:30.531970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18592-3689-43d2-9b9a-fcdebc640b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:30.532243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18592-3689-43d2-9b9a-fcdebc640b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:30.543621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde18592-3689-43d2-9b9a-fcdebc640b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:30.546636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde18592-3689-43d2-9b9a-fcdebc640b9a service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:30.558622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1114/2232] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:30.804016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:32.598708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:32.658122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa915e7b-0505-4dbe-9055-ada058db4e06 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:32.659014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa915e7b-0505-4dbe-9055-ada058db4e06 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:32.659014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa915e7b-0505-4dbe-9055-ada058db4e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:32.688020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-aa915e7b-0505-4dbe-9055-ada058db4e06 None None] MFA Rules not processed for user `f2d41981110c4b6c81239329efb127e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:32.689611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-aa915e7b-0505-4dbe-9055-ada058db4e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:32.794424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1119/2233] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:32.823448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:36.208535 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:37.051521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:38.616239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:40.644689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:41.069944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef36ec-80a3-4a14-8f5b-0e316bae972e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.069944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef36ec-80a3-4a14-8f5b-0e316bae972e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.069944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef36ec-80a3-4a14-8f5b-0e316bae972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.115242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-45ef36ec-80a3-4a14-8f5b-0e316bae972e None None] MFA Rules not processed for user `e3591e1e6c834269b13aa30c027cdc02`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:41.116675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-45ef36ec-80a3-4a14-8f5b-0e316bae972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:41.229145 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1115/2234] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:41.234868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa915e7b-0505-4dbe-9055-ada058db4e06 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:41.247540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa915e7b-0505-4dbe-9055-ada058db4e06 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:41.253453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:41.253976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.254265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.258005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.258005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:41.258005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:41.414675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1120/2235] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:32:41 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:32:41.429617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef36ec-80a3-4a14-8f5b-0e316bae972e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:41.444166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef36ec-80a3-4a14-8f5b-0e316bae972e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:41.546768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:41.547794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.548265 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.548733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.550079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:41.553899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:41.814689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1116/2236] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:32:41 2022] POST /identity/v3/users => generated 299 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:41.818794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:41.833450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3958-3cb1-45f5-82aa-f5a51605907f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:41.841435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:41.843113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.843731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.844477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.846320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:41.850348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:41.865968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1121/2237] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:41.885731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:41.897368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3443a-8732-462f-be07-f0045ff1f909 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:41.903301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:41.904128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.904428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.904710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] PATH_INFO: `/v3/projects/9166f6b7937540d1a406dc418ea9749d/users/49c9d8f1fd5649feb31135c949913e0c/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.931134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9166f6b7937540d1a406dc418ea9749d, user_id=49c9d8f1fd5649feb31135c949913e0c, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:41.939642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:42.178140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1117/2238] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:32:41 2022] PUT /identity/v3/projects/9166f6b7937540d1a406dc418ea9749d/users/49c9d8f1fd5649feb31135c949913e0c/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:42.184637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:42.196750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd6bc8-5fac-48ac-82cf-3d75a3907399 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:42.320279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:42.321860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:42.322439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:42.322814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:42.323617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:42.325644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:42.348555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1122/2239] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:42.357730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:42.373746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c87dfd-4783-4915-9377-f9af08d2bea2 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:42.384804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:42.386574 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:42.387085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:42.387759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] PATH_INFO: `/v3/projects/9166f6b7937540d1a406dc418ea9749d/users/49c9d8f1fd5649feb31135c949913e0c/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:42.391894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9166f6b7937540d1a406dc418ea9749d, user_id=49c9d8f1fd5649feb31135c949913e0c, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:42.401498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:42.402200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:42.415811 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1118/2240] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:32:42 2022] PUT /identity/v3/projects/9166f6b7937540d1a406dc418ea9749d/users/49c9d8f1fd5649feb31135c949913e0c/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:44.516944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:45.981846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:46.484788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:47.857009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:47.861187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:47.880228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7a2d4-56b3-4d23-b45e-17c13259480d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:47.915886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:47.953759 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:47.954483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.954834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.955170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] PATH_INFO: `/v3/users/9ed72b992c8f41bbafc6d890626d8dd2` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:47.956595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed72b992c8f41bbafc6d890626d8dd2)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:47.958898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:48.358605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed72b992c8f41bbafc6d890626d8dd2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:48.391507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed72b992c8f41bbafc6d890626d8dd2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:48.392702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed72b992c8f41bbafc6d890626d8dd2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:48.406166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed72b992c8f41bbafc6d890626d8dd2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:48.541032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed72b992c8f41bbafc6d890626d8dd2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:48.559599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1123/2241] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:47 2022] DELETE /identity/v3/users/9ed72b992c8f41bbafc6d890626d8dd2 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:49.057710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:49.059821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:49.091220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94789-e1ea-4ad5-87bb-101b12774fa1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:49.185840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:49.186539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:49.186868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:49.187148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] PATH_INFO: `/v3/projects/3fb1f24468e54a0daebc283cbf22c795` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:49.188492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb1f24468e54a0daebc283cbf22c795)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:49.190657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:49.315616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb1f24468e54a0daebc283cbf22c795', 'request_id': 'req-53d1c466-6843-4138-9346-7697227e3c77'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.321824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb1f24468e54a0daebc283cbf22c795', 'request_id': 'req-53d1c466-6843-4138-9346-7697227e3c77'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.328738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb1f24468e54a0daebc283cbf22c795', 'request_id': 'req-53d1c466-6843-4138-9346-7697227e3c77'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.455617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] The token cache is being invalidate because project 3fb1f24468e54a0daebc283cbf22c795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:49.456046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.457045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-53d1c466-6843-4138-9346-7697227e3c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.459292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1119/2242] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:49 2022] DELETE /identity/v3/projects/3fb1f24468e54a0daebc283cbf22c795 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:49.464290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:49.478409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99462af5-5016-4c2d-890d-302a6fa96602 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:49.481973 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:49.550103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:49.551007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:49.551346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:49.551685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] PATH_INFO: `/v3/users/b0eb725c496c44dca5cb88ad240e31d5` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:49.552950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eb725c496c44dca5cb88ad240e31d5)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:49.555122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:49.871990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eb725c496c44dca5cb88ad240e31d5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.906677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eb725c496c44dca5cb88ad240e31d5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.907967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eb725c496c44dca5cb88ad240e31d5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:49.920908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eb725c496c44dca5cb88ad240e31d5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:50.031429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eb725c496c44dca5cb88ad240e31d5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:50.064664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1124/2243] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:49 2022] DELETE /identity/v3/users/b0eb725c496c44dca5cb88ad240e31d5 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:50.091203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:50.091706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:50.092466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:50.158950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] MFA Rules not processed for user `49c9d8f1fd5649feb31135c949913e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:50.160346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:50.288229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1120/2244] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:50.301960 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:50.303444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:50.350511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:50.480268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777597-ff99-4a47-8460-536494832113 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:50.486360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8cb3f-30ad-4cff-9717-fda2e5d257cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:50.487231 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8cb3f-30ad-4cff-9717-fda2e5d257cc service glance] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:50.487509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8cb3f-30ad-4cff-9717-fda2e5d257cc service glance] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:50.487782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8cb3f-30ad-4cff-9717-fda2e5d257cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:50.490324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-bfb8cb3f-30ad-4cff-9717-fda2e5d257cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:50.548969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:50.550881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:50.580917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8cb3f-30ad-4cff-9717-fda2e5d257cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:50.582410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8cb3f-30ad-4cff-9717-fda2e5d257cc service glance] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:50.594596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1125/2245] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:50.661600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c01188-5a8b-4cb9-a567-2f65727129e9 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:50.666714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:50.667352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:50.667632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:50.667902 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] PATH_INFO: `/v3/projects/193197a4b9784837be064621b12d6428` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:50.669165 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=193197a4b9784837be064621b12d6428)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:50.672045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:50.893149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193197a4b9784837be064621b12d6428', 'request_id': 'req-ed144c43-179a-4215-bda9-6dded2ee83c7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:50.917827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193197a4b9784837be064621b12d6428', 'request_id': 'req-ed144c43-179a-4215-bda9-6dded2ee83c7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:50.940123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193197a4b9784837be064621b12d6428', 'request_id': 'req-ed144c43-179a-4215-bda9-6dded2ee83c7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:51.019923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.020373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.020821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.044163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:51.045422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:51.093556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] The token cache is being invalidate because project 193197a4b9784837be064621b12d6428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:51.094453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:51.095107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ed144c43-179a-4215-bda9-6dded2ee83c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:51.096703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1121/2246] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:50 2022] DELETE /identity/v3/projects/193197a4b9784837be064621b12d6428 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:32:51.102294 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2ff2-9dc7-4e47-8605-ae9a4af659a3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.102696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2ff2-9dc7-4e47-8605-ae9a4af659a3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.103182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2ff2-9dc7-4e47-8605-ae9a4af659a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.108190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1126/2247] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:51.132605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-47db2ff2-9dc7-4e47-8605-ae9a4af659a3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:51.134856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-47db2ff2-9dc7-4e47-8605-ae9a4af659a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:51.160100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.161586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:51.213978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1122/2248] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:51.222961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28448-b450-40df-9e2d-a11c83430dd0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.223243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28448-b450-40df-9e2d-a11c83430dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.223515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28448-b450-40df-9e2d-a11c83430dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.246929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-9eb28448-b450-40df-9e2d-a11c83430dd0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:51.247950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650f738-4489-4dc4-8223-a2c11f65064d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.248168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9eb28448-b450-40df-9e2d-a11c83430dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:51.254161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.254632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.255348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.255348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.261768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1123/2249] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:51.266579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb28448-b450-40df-9e2d-a11c83430dd0 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.267030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.268630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.277006 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb28448-b450-40df-9e2d-a11c83430dd0 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.278237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1127/2250] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:32:51.282998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.283623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.284079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.284357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.285018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:51.285351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.287120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.302365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1124/2251] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:51.308992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.326318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f47581-41af-45cc-a9cc-88de8da149d4 service swift] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.331615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.336992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.344243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.344243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.344243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.344243 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.470397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1128/2252] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:32:51 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:32:51.472990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.496370 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b03c5-6bc5-4c56-9894-6f72dff64315 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.617093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.618043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.618333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.618668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.619333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.621411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.771175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1125/2253] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:32:51 2022] POST /identity/v3/users => generated 286 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:51.776263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.810204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70bd7-4f9f-43bf-8039-e4e100d35bc4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.823601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.824888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.825452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.825873 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.827162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.829519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.881655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1129/2254] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:51.887590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.899994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc2270-a98d-4cb4-a132-b20591f9a048 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.907352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:51.908244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438226-8ec4-4d69-a955-5cd4284516c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.909142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438226-8ec4-4d69-a955-5cd4284516c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.909533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438226-8ec4-4d69-a955-5cd4284516c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.909917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438226-8ec4-4d69-a955-5cd4284516c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.910776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438226-8ec4-4d69-a955-5cd4284516c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.912556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438226-8ec4-4d69-a955-5cd4284516c2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.931985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1126/2255] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:32:51.932880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.950392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03400-13f5-4c7f-afe4-fdeec850131a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.970370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.971060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.971343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.971658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] PATH_INFO: `/v3/projects/1a776697a7774d77941d5e7adbc4b2b6/users/b481b91c44974ac7befc09aa642c4ba6/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.998214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a776697a7774d77941d5e7adbc4b2b6, user_id=b481b91c44974ac7befc09aa642c4ba6, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.001002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:52.154596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1130/2256] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:32:51 2022] PUT /identity/v3/projects/1a776697a7774d77941d5e7adbc4b2b6/users/b481b91c44974ac7befc09aa642c4ba6/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:52.168529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7197-33e9-4f4a-9a74-91d8f8561f23 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.170591 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7197-33e9-4f4a-9a74-91d8f8561f23 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.172932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7197-33e9-4f4a-9a74-91d8f8561f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.288575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-29ec7197-33e9-4f4a-9a74-91d8f8561f23 None None] MFA Rules not processed for user `b481b91c44974ac7befc09aa642c4ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:52.290345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-29ec7197-33e9-4f4a-9a74-91d8f8561f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:52.437274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1127/2257] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:52.458106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:52.460628 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:52.546512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9ad8-7a16-4ce5-b6ae-f2cdc6b66e2f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:52.559608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea57149-067e-4de7-8542-c220c124cddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:52.560487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57149-067e-4de7-8542-c220c124cddf service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.560876 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57149-067e-4de7-8542-c220c124cddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.561286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57149-067e-4de7-8542-c220c124cddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.586507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea57149-067e-4de7-8542-c220c124cddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.588183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea57149-067e-4de7-8542-c220c124cddf service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:52.608739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1131/2258] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:52.634052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec7197-33e9-4f4a-9a74-91d8f8561f23 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:52.777191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.781491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec7197-33e9-4f4a-9a74-91d8f8561f23 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:52.787528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:52.788554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.789548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.789962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] PATH_INFO: `/v3/users/b481b91c44974ac7befc09aa642c4ba6` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.791567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b481b91c44974ac7befc09aa642c4ba6)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.793876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:53.779618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b481b91c44974ac7befc09aa642c4ba6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:53.798539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b481b91c44974ac7befc09aa642c4ba6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:53.833882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b481b91c44974ac7befc09aa642c4ba6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:53.969241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b481b91c44974ac7befc09aa642c4ba6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:53.970283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b481b91c44974ac7befc09aa642c4ba6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:53.998312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:53.999424 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:54.000062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:54.001882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1128/2259] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:32:52 2022] DELETE /identity/v3/users/b481b91c44974ac7befc09aa642c4ba6 => generated 0 bytes in 1358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:54.041310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:54.042679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:54.200353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1132/2260] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:54.210499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:54.213602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:54.379832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599c81c-01dd-44f3-892b-cf5cddb77fbf admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:54.384652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf7d7-9d74-4e4a-919a-862fb63e2314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:54.390746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf7d7-9d74-4e4a-919a-862fb63e2314 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:54.390746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf7d7-9d74-4e4a-919a-862fb63e2314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:54.390746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf7d7-9d74-4e4a-919a-862fb63e2314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:54.413403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bf7d7-9d74-4e4a-919a-862fb63e2314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:54.417007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bf7d7-9d74-4e4a-919a-862fb63e2314 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:54.456867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1129/2261] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:55.499267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:55.500775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:55.524288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2433476-cfc5-45de-a3d6-98bdda2a210d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:55.533102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:55.533102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:55.533102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:55.533102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] PATH_INFO: `/v3/projects/1a776697a7774d77941d5e7adbc4b2b6` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:55.534802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a776697a7774d77941d5e7adbc4b2b6)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:55.537092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:55.739725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a776697a7774d77941d5e7adbc4b2b6', 'request_id': 'req-0510ec26-a328-4012-b409-e783bd7c6290'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:55.764311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:55.865527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a776697a7774d77941d5e7adbc4b2b6', 'request_id': 'req-0510ec26-a328-4012-b409-e783bd7c6290'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:55.875289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a776697a7774d77941d5e7adbc4b2b6', 'request_id': 'req-0510ec26-a328-4012-b409-e783bd7c6290'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:55.895503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] The token cache is being invalidate because project 1a776697a7774d77941d5e7adbc4b2b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:32:55.895951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:55.896731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0510ec26-a328-4012-b409-e783bd7c6290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:32:55.913217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1133/2262] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:32:55 2022] DELETE /identity/v3/projects/1a776697a7774d77941d5e7adbc4b2b6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:57.210441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:58.313943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:58.451553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:59.683841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:00.296093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:01.016033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:01.461816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:01.696283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:02.135902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:02.229031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:03.282429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:03.911107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:04.418709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:04.419393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:04.419393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:04.438977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] MFA Rules not processed for user `e3591e1e6c834269b13aa30c027cdc02`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:04.440198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:04.497438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1130/2263] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:33:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:04.581143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:05.272836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:06.347255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:07.073897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:07.842142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:08.238541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:08.341826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:08.902105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:09.179330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:09.510468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:09.511147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:09.511147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:09.531362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:09.532590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:09.600072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1134/2264] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:33:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:09.613494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:09.616367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:09.717241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354b42d-2475-4fe1-b42b-c2cbfc999fc1 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:09.726678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:09.727319 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:09.727594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:09.727903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:09.741611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:09.743412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:09.754188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1131/2265] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:33:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:10.067501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:10.201421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:10.765300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:11.054103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:12.100063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:12.176198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:13.707663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:14.032771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:14.307619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:14.439755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:14.523549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:14.839063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:14.907455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:15.247905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:15.840575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:16.679061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:17.122613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:17.542174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:17.599111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.208378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.293690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.508118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.537142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.690380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.723111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.836170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:18.873484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:19.505727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:19.580482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:19.807891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:19.843632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:20.183392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:20.362535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:20.562929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:20.646054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:20.764718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:20.896008 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:21.504924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:21.827730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:31.341696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=35,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:31.964259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:37.300737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:37.303273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:37.478559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a3a15-2cc6-4a7f-b5e4-876f733e1595 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:37.494298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487747d-13f2-45ab-92fe-99e53f9b9a9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:37.494298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487747d-13f2-45ab-92fe-99e53f9b9a9c service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:37.494298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487747d-13f2-45ab-92fe-99e53f9b9a9c service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:37.494298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487747d-13f2-45ab-92fe-99e53f9b9a9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:37.498409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9487747d-13f2-45ab-92fe-99e53f9b9a9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:37.522106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487747d-13f2-45ab-92fe-99e53f9b9a9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:37.526411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487747d-13f2-45ab-92fe-99e53f9b9a9c service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:37.541801 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1135/2266] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:43.011369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:43.013455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:43.127844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac077477-da30-4d8b-83fc-c9b52193be17 service swift] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:43.132317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:43.133483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:43.134011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:43.134520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:43.137703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:43.243017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22f05a-d27c-48cb-bfab-43bc0f1935cf None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:43.243670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22f05a-d27c-48cb-bfab-43bc0f1935cf None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:43.244496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22f05a-d27c-48cb-bfab-43bc0f1935cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:43.257682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:43.260280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:43.272335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1132/2267] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:43.273224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5f22f05a-d27c-48cb-bfab-43bc0f1935cf None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:43.276235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5f22f05a-d27c-48cb-bfab-43bc0f1935cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:43.289502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1136/2268] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:33:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:43.300924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:43.315185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8f1a-c5c2-41b9-82d2-6ed84a23d825 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:43.320105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a978179-1463-4a5b-8875-802fdf5e8ddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:43.320751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978179-1463-4a5b-8875-802fdf5e8ddd service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:43.321033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978179-1463-4a5b-8875-802fdf5e8ddd service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:43.321352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978179-1463-4a5b-8875-802fdf5e8ddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:43.335545 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a978179-1463-4a5b-8875-802fdf5e8ddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:43.337244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a978179-1463-4a5b-8875-802fdf5e8ddd service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:43.349168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1133/2269] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:33:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:53.264198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=35 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:53.344639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=56 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:01.220202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f12dd-e94e-41a4-9ea9-8d4813942203 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:01.220845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f12dd-e94e-41a4-9ea9-8d4813942203 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:01.220845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f12dd-e94e-41a4-9ea9-8d4813942203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:01.242020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-921f12dd-e94e-41a4-9ea9-8d4813942203 None None] MFA Rules not processed for user `1456c4aeb4b64ec5b81ab2c6df2abbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:01.243568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-921f12dd-e94e-41a4-9ea9-8d4813942203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:01.310150 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1137/2270] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:06.446638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c3b2-d797-4289-9622-40286c13c6a5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:06.447274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c3b2-d797-4289-9622-40286c13c6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:06.447562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c3b2-d797-4289-9622-40286c13c6a5 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:06.449336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1134/2271] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:34:06.457695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd15e27-eab2-4001-b7f1-0c1682d5c379 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:06.458249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd15e27-eab2-4001-b7f1-0c1682d5c379 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:06.458368 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd15e27-eab2-4001-b7f1-0c1682d5c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:06.480869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9fd15e27-eab2-4001-b7f1-0c1682d5c379 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:06.482127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9fd15e27-eab2-4001-b7f1-0c1682d5c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:06.561378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1138/2272] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:06.575955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58c3b2-d797-4289-9622-40286c13c6a5 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:06.578749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-eb58c3b2-d797-4289-9622-40286c13c6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:06.647599 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58c3b2-d797-4289-9622-40286c13c6a5 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:06.653031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd9170-bde3-4ffe-8ffd-c7da0c1e242d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:06.654661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd9170-bde3-4ffe-8ffd-c7da0c1e242d service glance] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:06.655569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd9170-bde3-4ffe-8ffd-c7da0c1e242d service glance] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:06.655891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd9170-bde3-4ffe-8ffd-c7da0c1e242d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:06.671023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd9170-bde3-4ffe-8ffd-c7da0c1e242d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:06.672850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd9170-bde3-4ffe-8ffd-c7da0c1e242d service glance] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:06.693987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1135/2273] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:34:06.963813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ff82-a0fc-4b3f-ae5b-e582fee889e2 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:06.964249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ff82-a0fc-4b3f-ae5b-e582fee889e2 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:06.964720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ff82-a0fc-4b3f-ae5b-e582fee889e2 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:06.970033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1139/2274] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:34:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:34:06.974957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8612-8e3e-47db-be73-9dab314a8e3b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:06.975350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8612-8e3e-47db-be73-9dab314a8e3b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:06.976113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8612-8e3e-47db-be73-9dab314a8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:06.999396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-58df8612-8e3e-47db-be73-9dab314a8e3b None None] MFA Rules not processed for user `e72f7d1f9961446c8938e3f161fb03f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:07.000643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-58df8612-8e3e-47db-be73-9dab314a8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:07.013235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1136/2275] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:07.022119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ff82-a0fc-4b3f-ae5b-e582fee889e2 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:07.034343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ff82-a0fc-4b3f-ae5b-e582fee889e2 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:07.038336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa35e4-4e3c-4e97-abd9-bde04355aa2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:07.038944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa35e4-4e3c-4e97-abd9-bde04355aa2b service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:07.039229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa35e4-4e3c-4e97-abd9-bde04355aa2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:07.039510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa35e4-4e3c-4e97-abd9-bde04355aa2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:07.047947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa35e4-4e3c-4e97-abd9-bde04355aa2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:07.049552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa35e4-4e3c-4e97-abd9-bde04355aa2b service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:07.059256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1140/2276] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:34:07.147744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df4845-cbf2-4e2d-acfb-f9d6c2f337c5 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:07.148105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df4845-cbf2-4e2d-acfb-f9d6c2f337c5 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:07.148316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df4845-cbf2-4e2d-acfb-f9d6c2f337c5 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:07.150263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1137/2277] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:34:07.156468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f28872-41c8-4c39-af73-1be83a814452 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:07.156851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f28872-41c8-4c39-af73-1be83a814452 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:07.157226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f28872-41c8-4c39-af73-1be83a814452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:07.181237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-30f28872-41c8-4c39-af73-1be83a814452 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:07.182478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-30f28872-41c8-4c39-af73-1be83a814452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:07.192560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1141/2278] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:07.204967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df4845-cbf2-4e2d-acfb-f9d6c2f337c5 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:07.219784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df4845-cbf2-4e2d-acfb-f9d6c2f337c5 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:07.224414 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:07.225027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:07.225336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:07.225605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:07.238547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:07.240028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:07.251688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1138/2279] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:34:14.216451 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f890-f660-4d01-8e05-85e154642444 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:14.216999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f890-f660-4d01-8e05-85e154642444 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:14.216999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f890-f660-4d01-8e05-85e154642444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:14.238619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-03b1f890-f660-4d01-8e05-85e154642444 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:14.239860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-03b1f890-f660-4d01-8e05-85e154642444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:14.247813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1142/2280] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:14.261383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:14.273197 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c6b0-91cf-40e5-953d-de56984be0ad service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:14.279030 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eac80-cd63-497a-92b8-a08ed7546bec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:14.279651 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eac80-cd63-497a-92b8-a08ed7546bec service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:14.279955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eac80-cd63-497a-92b8-a08ed7546bec service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:14.280230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eac80-cd63-497a-92b8-a08ed7546bec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:14.289671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eac80-cd63-497a-92b8-a08ed7546bec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:14.291829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eac80-cd63-497a-92b8-a08ed7546bec service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:14.300884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1139/2281] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:34:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:34:24.231755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=68 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:24.297309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=41 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:34.866383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d77d8-95be-408f-a813-2618f25195eb None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:34.866981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d77d8-95be-408f-a813-2618f25195eb None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:34.866981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d77d8-95be-408f-a813-2618f25195eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:34.888318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-565d77d8-95be-408f-a813-2618f25195eb None None] MFA Rules not processed for user `f2d41981110c4b6c81239329efb127e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:34.889747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-565d77d8-95be-408f-a813-2618f25195eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:34.961980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1143/2282] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:38.804904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7679db-2fe8-41f4-bb3e-61ef10ea32bf None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:38.805604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7679db-2fe8-41f4-bb3e-61ef10ea32bf None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:38.805604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7679db-2fe8-41f4-bb3e-61ef10ea32bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:38.825148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5d7679db-2fe8-41f4-bb3e-61ef10ea32bf None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:38.826389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5d7679db-2fe8-41f4-bb3e-61ef10ea32bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:38.833930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1140/2283] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:34:38.847796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d77d8-95be-408f-a813-2618f25195eb None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:38.864350 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d77d8-95be-408f-a813-2618f25195eb None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:38.869548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:38.870187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:38.870500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:38.870774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:38.880397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:38.882420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:38.892495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1144/2284] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:34:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:48.819765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:48.888545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=31 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:07.007831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75189-5112-4db7-9257-e870c67680c0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:07.008435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75189-5112-4db7-9257-e870c67680c0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:07.008435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75189-5112-4db7-9257-e870c67680c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:07.028681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-eae75189-5112-4db7-9257-e870c67680c0 None None] MFA Rules not processed for user `b13474d8ec71457db4fa030d40ab8751`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:35:07.029916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-eae75189-5112-4db7-9257-e870c67680c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:07.107485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1141/2285] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:35:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:35:07.148023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:07.153983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:07.162972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9377f1-7b7f-467b-987b-76b579cf4f0a service swift] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:07.166983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:07.167599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:07.167868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:07.168142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:07.170737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:07.187119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:07.188743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:07.208060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1145/2286] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:08.962114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75189-5112-4db7-9257-e870c67680c0 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:08.974820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75189-5112-4db7-9257-e870c67680c0 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:08.978855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:08.979657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:08.980003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:08.980270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:08.982426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:08.998059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:08.999499 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:09.011671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1142/2287] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:17.199180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=6 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:19.006080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=31 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:20.549643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:20.551409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:20.567672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b5ceb-f469-4279-b444-818cf1d3938c service glance] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:20.574700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:20.574957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:20.575130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:20.575296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:20.577273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:20.589900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:20.591514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:20.602410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1146/2288] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:30.597874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=6 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:33.772902 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:33.774474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:33.790325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803fb05-66ce-4dd7-bf4b-09980f2e4f5e service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:33.796813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:33.801322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:33.801322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:33.801322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:33.801322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:33.813264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:33.815057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:33.826051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1143/2289] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:35.061314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:35.063078 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:35.130423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7017dc5-7e0b-4cd2-8b3d-3d0a45894f70 service nova] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:35.135792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597d05-cd1d-4948-8cdf-58fba2cc3e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:35.136433 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597d05-cd1d-4948-8cdf-58fba2cc3e0a service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:35.136711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597d05-cd1d-4948-8cdf-58fba2cc3e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:35.136981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597d05-cd1d-4948-8cdf-58fba2cc3e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:35.139011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-18597d05-cd1d-4948-8cdf-58fba2cc3e0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:35.153886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597d05-cd1d-4948-8cdf-58fba2cc3e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:35.156666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597d05-cd1d-4948-8cdf-58fba2cc3e0a service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:35.167379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1147/2290] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:43.820989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=6 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:45.162501 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=26 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:56.025873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:56.051903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16782e-2724-4da1-870f-cd9ccd49db56 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:56.059641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:56.061003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:56.061910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:56.062440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:56.065854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:56.118901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:56.124952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:56.142467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1144/2291] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:56.521796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6a93-e6af-41c6-9b30-a6cbdfcdd042 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:56.522794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6a93-e6af-41c6-9b30-a6cbdfcdd042 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:56.523268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6a93-e6af-41c6-9b30-a6cbdfcdd042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:56.546674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4e3d6a93-e6af-41c6-9b30-a6cbdfcdd042 None None] MFA Rules not processed for user `3383f068af3f4509b781b77a6b56da7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:35:56.548065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4e3d6a93-e6af-41c6-9b30-a6cbdfcdd042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:56.650536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1148/2292] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:35:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:35:57.025892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:57.027685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:57.044176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d98ad-23e8-47b7-9861-6afb520ded96 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:57.050010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:57.050655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:57.051190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:57.051467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:57.053413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:57.065547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:57.067001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:57.077567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1145/2293] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:57.585270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d6a93-e6af-41c6-9b30-a6cbdfcdd042 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:57.599166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d6a93-e6af-41c6-9b30-a6cbdfcdd042 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:57.604779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94f783-56ed-44c5-b978-9b2f8bfdf1da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:57.605441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f783-56ed-44c5-b978-9b2f8bfdf1da service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:57.605720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f783-56ed-44c5-b978-9b2f8bfdf1da service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:57.605991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f783-56ed-44c5-b978-9b2f8bfdf1da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:57.607835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-bb94f783-56ed-44c5-b978-9b2f8bfdf1da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:57.624374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94f783-56ed-44c5-b978-9b2f8bfdf1da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:57.626121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94f783-56ed-44c5-b978-9b2f8bfdf1da service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:57.637260 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1149/2294] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:01.750158 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:01.762037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63cff8-6416-4f46-b80c-56ed11c2b2ac service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:01.766046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:01.766794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:01.767475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:01.767886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:01.769695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:01.782228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:01.783804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:01.793560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1146/2295] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:06.068372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad40ac-1afa-49a8-bcc5-3a58f8892fde None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:06.069008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad40ac-1afa-49a8-bcc5-3a58f8892fde None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:06.069008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad40ac-1afa-49a8-bcc5-3a58f8892fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:06.089002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-dcad40ac-1afa-49a8-bcc5-3a58f8892fde None None] MFA Rules not processed for user `1456c4aeb4b64ec5b81ab2c6df2abbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:06.090280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-dcad40ac-1afa-49a8-bcc5-3a58f8892fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:06.098107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1150/2296] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:36:08.592965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:08.616835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5e830-6f13-4c3d-a030-52d9dab2f6ea service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:08.627429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:08.628260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:08.628726 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:08.629251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:08.631747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:08.646161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:08.647731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:08.660557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1147/2297] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:13.059799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad40ac-1afa-49a8-bcc5-3a58f8892fde None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:13.074046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad40ac-1afa-49a8-bcc5-3a58f8892fde None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:13.086014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00735c7-0ab4-4d1f-956d-24d648a84121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:13.087275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00735c7-0ab4-4d1f-956d-24d648a84121 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:13.087569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00735c7-0ab4-4d1f-956d-24d648a84121 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:13.087848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00735c7-0ab4-4d1f-956d-24d648a84121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:13.089810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c00735c7-0ab4-4d1f-956d-24d648a84121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:13.103925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00735c7-0ab4-4d1f-956d-24d648a84121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:13.105652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00735c7-0ab4-4d1f-956d-24d648a84121 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:13.120514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1151/2298] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:14.116376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:14.127303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d822a0-5c8e-482c-bd45-e360b497ffc1 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:14.131290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:14.131904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:14.132186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:14.132538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:14.134533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:14.208738 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:14.210405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:14.222971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1148/2299] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:36:18.049276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:18.049717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:18.049819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:18.077399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:18.080195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:18.097431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1152/2300] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:36:18.322119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:18.339073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639565-4218-4318-92a0-61784488adb2 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:18.353998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:18.355021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:18.355312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:18.355782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:18.368559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:18.370277 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:18.381224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1149/2301] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:36:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:36:19.659480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:19.661300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:19.683334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056124a8-c532-472a-9cdd-b43a63fe8db1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:19.695815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:19.696813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:19.697345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:19.697887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:19.700215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:19.716093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:19.718613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:19.731491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1153/2302] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:19.833795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:19.837431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:19.865328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df78ab-78c3-4551-8672-32cc520181ac service swift] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:19.871914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:19.872783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:19.873631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:19.888638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] PATH_INFO: `/v3/users/f2d41981110c4b6c81239329efb127e4` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:19.888638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d41981110c4b6c81239329efb127e4)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:19.888638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:20.112835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d41981110c4b6c81239329efb127e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:20.138497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d41981110c4b6c81239329efb127e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:20.148806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d41981110c4b6c81239329efb127e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:20.244065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d41981110c4b6c81239329efb127e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:20.244065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5705017e-018a-466e-81ad-61d2b468ab06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d41981110c4b6c81239329efb127e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:20.244065 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:20.254099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1150/2303] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:36:19 2022] DELETE /identity/v3/users/f2d41981110c4b6c81239329efb127e4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:20.702011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:20.724445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59514d3-6af8-4bd8-b11f-daf70c7f534a service placement] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:20.804108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:20.804957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:20.805398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:20.805799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] PATH_INFO: `/v3/projects/7d2d213cc34c4995ae21446a5323e30c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:20.807700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2d213cc34c4995ae21446a5323e30c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:20.811959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:20.998976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2d213cc34c4995ae21446a5323e30c', 'request_id': 'req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:21.003258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:21.076426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2d213cc34c4995ae21446a5323e30c', 'request_id': 'req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:21.088909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2d213cc34c4995ae21446a5323e30c', 'request_id': 'req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:21.110296 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] The token cache is being invalidate because project 7d2d213cc34c4995ae21446a5323e30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:36:21.110864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:21.111788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f2a14f16-d4d6-4675-b9dc-97f26b24a6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:21.118285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1154/2304] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:36:20 2022] DELETE /identity/v3/projects/7d2d213cc34c4995ae21446a5323e30c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:36:21.119939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1e335-c736-482c-b2b3-8a378e67d755 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.120634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1e335-c736-482c-b2b3-8a378e67d755 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.120634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1e335-c736-482c-b2b3-8a378e67d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:21.159911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-efe1e335-c736-482c-b2b3-8a378e67d755 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:21.159911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-efe1e335-c736-482c-b2b3-8a378e67d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:21.328318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1151/2305] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:36:21.328467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87527-3678-4d53-b500-f7ec00d942e0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.328467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87527-3678-4d53-b500-f7ec00d942e0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.328467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87527-3678-4d53-b500-f7ec00d942e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:21.349952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a9a87527-3678-4d53-b500-f7ec00d942e0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:21.351298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a9a87527-3678-4d53-b500-f7ec00d942e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:21.360077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1155/2306] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:36:21.364729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1e335-c736-482c-b2b3-8a378e67d755 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:21.377234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1e335-c736-482c-b2b3-8a378e67d755 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:21.383796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:21.384698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.385332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.392128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:21.392128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:36:21.392128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:21.392128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:21.403911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1152/2307] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:36:21.409661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a87527-3678-4d53-b500-f7ec00d942e0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:21.422635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a87527-3678-4d53-b500-f7ec00d942e0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:21.430223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:21.434128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.434128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.434128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:21.434128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:21.434128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:21.538506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1156/2308] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:36:21 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:21.543115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:21.553931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a473bc4-a544-4900-a7a1-35a7dc792270 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:21.617379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:21.618029 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.618314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.618596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:21.619303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:21.621256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:21.775932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1153/2309] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:36:21 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:21.786760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:21.792059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707c1f-7a57-44a9-aa34-bbaa326d6a7b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:21.799606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:21.800790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.801665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.802116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:21.803169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:21.805309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:21.822075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1157/2310] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:36:21.823748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:21.850640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95d19-0a24-4090-ad0e-a355c7f52f59 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:21.889016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e2bc-d680-4288-8caa-4563c4d40a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:21.890790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e2bc-d680-4288-8caa-4563c4d40a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.891091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e2bc-d680-4288-8caa-4563c4d40a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.891356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e2bc-d680-4288-8caa-4563c4d40a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:21.892094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e2bc-d680-4288-8caa-4563c4d40a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:21.899496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e2bc-d680-4288-8caa-4563c4d40a28 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:21.927004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1154/2311] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:36:21.931701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:21.949529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb996991-77e8-423a-81a7-9f52e28204ad admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:21.960625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:21.962643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:21.965711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:21.966216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] PATH_INFO: `/v3/projects/72fcef54e53249908cfe42e1e569a01a/users/6abe7757171542be8107b4cbd26f06a0/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:22.017878 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fcef54e53249908cfe42e1e569a01a, user_id=6abe7757171542be8107b4cbd26f06a0, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:22.019635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:22.106110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1158/2312] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:36:21 2022] PUT /identity/v3/projects/72fcef54e53249908cfe42e1e569a01a/users/6abe7757171542be8107b4cbd26f06a0/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:22.119133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee860-a15a-4313-8a30-b1e0269ff59b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:22.119422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee860-a15a-4313-8a30-b1e0269ff59b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:22.119695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee860-a15a-4313-8a30-b1e0269ff59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:22.171412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b26ee860-a15a-4313-8a30-b1e0269ff59b None None] MFA Rules not processed for user `6abe7757171542be8107b4cbd26f06a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:22.173092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b26ee860-a15a-4313-8a30-b1e0269ff59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:22.264476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:22.278460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1155/2313] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:36:22.284928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:22.359128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84867-6d27-4db4-931b-1e3af7794acc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:22.364504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:22.365233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:22.365740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:22.366035 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:22.367144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:22.369159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:22.484530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1159/2314] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:36:22 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:22.488927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ee860-a15a-4313-8a30-b1e0269ff59b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:22.507069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ee860-a15a-4313-8a30-b1e0269ff59b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:22.578378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:22.579035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:22.579341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:22.579596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:22.580329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:22.582409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:22.688038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1156/2315] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:36:22 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:22.693048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:22.707186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b3206-9bc2-49d0-be2e-a0cd014f8816 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:22.712338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:22.713104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:22.713490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:22.713862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:22.714612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:22.717386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:22.736673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1160/2316] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:36:22.741477 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:22.754423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e348a-b871-4593-b43d-b851012498d3 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:22.759965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:22.760665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:22.760948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:22.761332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] PATH_INFO: `/v3/projects/64e452ce2f2747b6a2df73a1dbd4b83f/users/79ee3ffd53aa473aa8646665473529f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:22.786675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e452ce2f2747b6a2df73a1dbd4b83f, user_id=79ee3ffd53aa473aa8646665473529f6, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:22.792909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:22.932274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1157/2317] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:36:22 2022] PUT /identity/v3/projects/64e452ce2f2747b6a2df73a1dbd4b83f/users/79ee3ffd53aa473aa8646665473529f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:22.937115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:22.955525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a416-763d-4e0d-81dc-d571290897c1 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:23.075094 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:23.101247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ae0d2-be07-4aa0-980a-b0d03f63f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:23.102393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ae0d2-be07-4aa0-980a-b0d03f63f2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:23.104190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ae0d2-be07-4aa0-980a-b0d03f63f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:23.104749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ae0d2-be07-4aa0-980a-b0d03f63f2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:23.106256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ae0d2-be07-4aa0-980a-b0d03f63f2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:23.113552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ae0d2-be07-4aa0-980a-b0d03f63f2a1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:23.142248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1161/2318] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:36:23.146831 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:23.164016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caf7c8-96c7-422a-9815-f25ae4c736ec admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:23.175155 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:23.178518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:23.179042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:23.179479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] PATH_INFO: `/v3/projects/64e452ce2f2747b6a2df73a1dbd4b83f/users/79ee3ffd53aa473aa8646665473529f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:23.182694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e452ce2f2747b6a2df73a1dbd4b83f, user_id=79ee3ffd53aa473aa8646665473529f6, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:23.185906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:23.217737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1158/2319] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:36:23 2022] PUT /identity/v3/projects/64e452ce2f2747b6a2df73a1dbd4b83f/users/79ee3ffd53aa473aa8646665473529f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:23.219618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac83bd-da1f-47a4-8346-5c0c025f6d73 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:23.219765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac83bd-da1f-47a4-8346-5c0c025f6d73 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:23.220408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac83bd-da1f-47a4-8346-5c0c025f6d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:23.268352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-94ac83bd-da1f-47a4-8346-5c0c025f6d73 None None] MFA Rules not processed for user `79ee3ffd53aa473aa8646665473529f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:23.273909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-94ac83bd-da1f-47a4-8346-5c0c025f6d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:23.434134 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1162/2320] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:36:23.452956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:23.453713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:23.536773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc963664-ccf8-4abf-9777-e44f7744a7e7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:23.544458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:23.545143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:23.545543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:23.545696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:23.560033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:23.562160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:23.574429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1159/2321] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:23.880310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac83bd-da1f-47a4-8346-5c0c025f6d73 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:23.892244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac83bd-da1f-47a4-8346-5c0c025f6d73 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:23.896743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:23.897699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:23.898054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:23.898399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:23.975352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:23.976834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:23.987858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1163/2322] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:25.423752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:25.427036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:25.522037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:25.553483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654524b0-9c80-4c64-867a-e06f2b271411 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:25.559821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:25.560763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:25.561243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:25.561663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:25.564000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:25.584077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:25.586860 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:25.600884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1160/2323] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:31.160460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:31.162904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:31.321947 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fa9cd-e6b8-45fb-a28d-a0ea5bd9a38d service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:31.328535 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:31.329387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:31.329675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:31.329953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] PATH_INFO: `/v3/users/e3591e1e6c834269b13aa30c027cdc02` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:31.331180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3591e1e6c834269b13aa30c027cdc02)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:31.335807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:31.362214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:31.680664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3591e1e6c834269b13aa30c027cdc02'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:31.698432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3591e1e6c834269b13aa30c027cdc02'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:31.699184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3591e1e6c834269b13aa30c027cdc02'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:31.708774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3591e1e6c834269b13aa30c027cdc02'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:31.835748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3591e1e6c834269b13aa30c027cdc02'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:31.849667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1164/2324] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:36:31 2022] DELETE /identity/v3/users/e3591e1e6c834269b13aa30c027cdc02 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:32.258569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:32.281946 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a066aa-a846-409a-aebb-1c43ed2bc673 service placement] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:32.389335 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:32.390834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:32.391222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:32.391497 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] PATH_INFO: `/v3/projects/c7f904fecd234c8989b35a2d308577d1` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:32.392800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f904fecd234c8989b35a2d308577d1)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:32.394820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:32.637100 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f904fecd234c8989b35a2d308577d1', 'request_id': 'req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:32.647782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f904fecd234c8989b35a2d308577d1', 'request_id': 'req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:32.657486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f904fecd234c8989b35a2d308577d1', 'request_id': 'req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:32.826832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] The token cache is being invalidate because project c7f904fecd234c8989b35a2d308577d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:36:32.826832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:32.826832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:32.826832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1161/2325] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:36:32 2022] DELETE /identity/v3/projects/c7f904fecd234c8989b35a2d308577d1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:32.827441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:32.827441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:32.850355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b077a-5eec-4639-a0ae-b5cc1a6f3966 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:32.934991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:32.936275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:32.936623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:32.937209 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] PATH_INFO: `/v3/users/49c9d8f1fd5649feb31135c949913e0c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:32.939138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c9d8f1fd5649feb31135c949913e0c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:32.942555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:33.174204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c9d8f1fd5649feb31135c949913e0c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:33.192806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c9d8f1fd5649feb31135c949913e0c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:33.194171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c9d8f1fd5649feb31135c949913e0c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:33.208021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c9d8f1fd5649feb31135c949913e0c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:33.334267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c9d8f1fd5649feb31135c949913e0c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:33.349547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1165/2326] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:36:32 2022] DELETE /identity/v3/users/49c9d8f1fd5649feb31135c949913e0c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:36:33.696602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:33.698468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:33.717163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e3fcc-62c8-4c53-8df9-86fd2834fe5f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:33.789552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:33.790133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:33.790409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:33.790682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] PATH_INFO: `/v3/projects/9166f6b7937540d1a406dc418ea9749d` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:33.791959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9166f6b7937540d1a406dc418ea9749d)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:33.794203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:33.808833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:33.998628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9166f6b7937540d1a406dc418ea9749d', 'request_id': 'req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:34.008637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9166f6b7937540d1a406dc418ea9749d', 'request_id': 'req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:34.016830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9166f6b7937540d1a406dc418ea9749d', 'request_id': 'req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:34.146524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] The token cache is being invalidate because project 9166f6b7937540d1a406dc418ea9749d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:36:34.147239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:34.148352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:34.151207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1162/2327] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:36:33 2022] DELETE /identity/v3/projects/9166f6b7937540d1a406dc418ea9749d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:43.338644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:44.140732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:52.163431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:52.164976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:52.228086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b625cb-2087-4134-98df-3865599b0a2d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:52.278360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:52.283832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:52.283832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:52.283832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:52.283832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:52.362455 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:52.363892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:52.380192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1166/2328] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:36:56.526917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:56.529123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:56.547432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868050c-0cab-45c3-ba5d-870aa6aa1ba7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:56.549975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:56.550620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:56.550896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:56.551166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] PATH_INFO: `/v3/users/b13474d8ec71457db4fa030d40ab8751` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:56.552446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13474d8ec71457db4fa030d40ab8751)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:56.554699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:56.776457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13474d8ec71457db4fa030d40ab8751'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:56.789692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13474d8ec71457db4fa030d40ab8751'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:56.797566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13474d8ec71457db4fa030d40ab8751'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:56.907773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13474d8ec71457db4fa030d40ab8751'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:56.908449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-139351eb-3f89-4c4f-a324-d9d1b5c3df6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13474d8ec71457db4fa030d40ab8751'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:56.916017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1163/2329] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:36:56 2022] DELETE /identity/v3/users/b13474d8ec71457db4fa030d40ab8751 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:57.175136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:57.186468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2578-7b52-49db-8c3b-4228c1848484 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:57.252566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:57.253250 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:57.253533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:57.253804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] PATH_INFO: `/v3/projects/0db992826e874a8396ebf763a24f3ae7` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:57.254992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db992826e874a8396ebf763a24f3ae7)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:57.256980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:57.266621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:57.409046 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db992826e874a8396ebf763a24f3ae7', 'request_id': 'req-8a00286e-69a2-48b3-a400-21ca21ae68e5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:57.493444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db992826e874a8396ebf763a24f3ae7', 'request_id': 'req-8a00286e-69a2-48b3-a400-21ca21ae68e5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:57.499725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db992826e874a8396ebf763a24f3ae7', 'request_id': 'req-8a00286e-69a2-48b3-a400-21ca21ae68e5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:57.511388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] The token cache is being invalidate because project 0db992826e874a8396ebf763a24f3ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:36:57.511679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:57.512342 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8a00286e-69a2-48b3-a400-21ca21ae68e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:36:57.513922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1167/2330] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:36:57 2022] DELETE /identity/v3/projects/0db992826e874a8396ebf763a24f3ae7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:57.519111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634c20-65a0-4e89-ac1b-7de47fa1ba7e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:57.519404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634c20-65a0-4e89-ac1b-7de47fa1ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:57.519684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634c20-65a0-4e89-ac1b-7de47fa1ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:57.540416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ef634c20-65a0-4e89-ac1b-7de47fa1ba7e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:57.541669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ef634c20-65a0-4e89-ac1b-7de47fa1ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:57.605310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1164/2331] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:36:57.614662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88119f0-74fe-4cbe-9025-1d2378589fbc None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:57.615032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88119f0-74fe-4cbe-9025-1d2378589fbc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:57.615308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88119f0-74fe-4cbe-9025-1d2378589fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:57.636348 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b88119f0-74fe-4cbe-9025-1d2378589fbc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:57.638461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b88119f0-74fe-4cbe-9025-1d2378589fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:57.646448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1168/2332] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:36:57.650837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634c20-65a0-4e89-ac1b-7de47fa1ba7e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:57.661554 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634c20-65a0-4e89-ac1b-7de47fa1ba7e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:57.666253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:57.666857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:57.667139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:57.667412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:57.668058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:36:57.668368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:57.670081 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:57.682099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1165/2333] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:36:57.686472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88119f0-74fe-4cbe-9025-1d2378589fbc None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:57.695930 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88119f0-74fe-4cbe-9025-1d2378589fbc None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:57.701153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:57.701752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:57.702028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:57.702298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:57.702925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:57.704807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:57.824653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1169/2334] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:36:57 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:57.829569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:57.840524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a24df-8599-46b5-ae6a-39f11455ba78 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:57.899723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:57.900332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:57.900608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:57.900877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:57.901561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:57.903466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:57.915830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:58.005943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1166/2335] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:36:57 2022] POST /identity/v3/users => generated 282 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:58.007601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:58.018788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283645c6-7dad-4f9d-bd77-d9166a334610 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:58.023558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:58.024161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.024442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.024711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.025402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:58.027025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:58.037538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1170/2336] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:36:58.042550 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:58.052469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f6fcd-a6c2-4ea2-a989-2b23a5843bd5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:58.057503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a875-609a-4dbd-8e47-93a483c796ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:58.062676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a875-609a-4dbd-8e47-93a483c796ba admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.062676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a875-609a-4dbd-8e47-93a483c796ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.062676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a875-609a-4dbd-8e47-93a483c796ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.062676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a875-609a-4dbd-8e47-93a483c796ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:58.063449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a875-609a-4dbd-8e47-93a483c796ba admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:58.074959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1167/2337] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:36:58.079776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:58.090332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb1c9a-5d3f-42e3-89df-c9a1bf341f34 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:58.095389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:58.096037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.096318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.096594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] PATH_INFO: `/v3/projects/209a5fbcde7544c7b036678da602644c/users/16eec85213f8418da7ebe0665b8f9b10/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.112132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209a5fbcde7544c7b036678da602644c, user_id=16eec85213f8418da7ebe0665b8f9b10, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:58.114834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:58.197739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1171/2338] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:36:58 2022] PUT /identity/v3/projects/209a5fbcde7544c7b036678da602644c/users/16eec85213f8418da7ebe0665b8f9b10/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:58.208686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54883c-cb66-426d-8238-79e3e24645c0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.208967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54883c-cb66-426d-8238-79e3e24645c0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.209296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54883c-cb66-426d-8238-79e3e24645c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.238392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-0c54883c-cb66-426d-8238-79e3e24645c0 None None] MFA Rules not processed for user `16eec85213f8418da7ebe0665b8f9b10`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:58.239613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0c54883c-cb66-426d-8238-79e3e24645c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:58.308660 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1168/2339] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:36:58.314077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:58.379014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6be4b2-88e1-4962-8b20-42a8364ff791 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:58.383747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:58.384358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.384636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.384904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.385568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:58.387450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:58.586333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1172/2340] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:36:58 2022] POST /identity/v3/projects => generated 361 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:58.590633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54883c-cb66-426d-8238-79e3e24645c0 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:58.605130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54883c-cb66-426d-8238-79e3e24645c0 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:58.669968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:58.670586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.670866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.671134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.671774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:58.673740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:58.819619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1169/2341] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:36:58 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:36:58.823837 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:58.837253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846a88e-e3e0-4f0e-90e5-3be24e0cc9a5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:58.842872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:58.843568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.843846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.844186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.844834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:58.846763 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:58.862738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1173/2342] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:36:58.866987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:58.877508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f66b-d8af-409f-84ae-ca435c664348 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:58.882310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:58.882982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:58.883266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:58.883573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] PATH_INFO: `/v3/projects/0c95702ce30d4271af03be026648463a/users/32b6b0b20ee14619a52f693765300ffa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:58.900187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c95702ce30d4271af03be026648463a, user_id=32b6b0b20ee14619a52f693765300ffa, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:58.903082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:59.022823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1170/2343] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:36:58 2022] PUT /identity/v3/projects/0c95702ce30d4271af03be026648463a/users/32b6b0b20ee14619a52f693765300ffa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:59.027004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:59.038267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd04a87-0e94-4dd0-9cc8-8e9ceaa7b8cc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:59.042202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:59.097976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63e16d-3eba-4ee2-8c05-b540d1980cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:59.098505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e16d-3eba-4ee2-8c05-b540d1980cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:59.098780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e16d-3eba-4ee2-8c05-b540d1980cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:59.099300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e16d-3eba-4ee2-8c05-b540d1980cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:59.099934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63e16d-3eba-4ee2-8c05-b540d1980cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:59.101605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63e16d-3eba-4ee2-8c05-b540d1980cd8 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:59.112032 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1174/2344] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:36:59.116748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:59.127296 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4c7f-bcc1-4cd7-9220-3ee269b5906e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:59.132493 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:59.133276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:59.133560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:59.133864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] PATH_INFO: `/v3/projects/0c95702ce30d4271af03be026648463a/users/32b6b0b20ee14619a52f693765300ffa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:59.136017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c95702ce30d4271af03be026648463a, user_id=32b6b0b20ee14619a52f693765300ffa, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:59.139432 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:59.150666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1171/2345] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:36:59 2022] PUT /identity/v3/projects/0c95702ce30d4271af03be026648463a/users/32b6b0b20ee14619a52f693765300ffa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:36:59.163507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb9df2-4a5f-4deb-a528-394b9200e0d6 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:59.163788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb9df2-4a5f-4deb-a528-394b9200e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:59.164061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb9df2-4a5f-4deb-a528-394b9200e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:59.194194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6ecb9df2-4a5f-4deb-a528-394b9200e0d6 None None] MFA Rules not processed for user `32b6b0b20ee14619a52f693765300ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:36:59.195435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6ecb9df2-4a5f-4deb-a528-394b9200e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:59.267781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1175/2346] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:36:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:36:59.280538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:36:59.282263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:36:59.305428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:59.346933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4da0-d037-47cb-9ab0-dff6e2aa720b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:36:59.351068 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8df7-6460-4e3d-9c78-421237e4cdfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:36:59.351621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8df7-6460-4e3d-9c78-421237e4cdfd service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:36:59.351901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8df7-6460-4e3d-9c78-421237e4cdfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:36:59.352169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8df7-6460-4e3d-9c78-421237e4cdfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:36:59.362520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d8df7-6460-4e3d-9c78-421237e4cdfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:36:59.363947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d8df7-6460-4e3d-9c78-421237e4cdfd service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:36:59.374246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1172/2347] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:36:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:00.314203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb9df2-4a5f-4deb-a528-394b9200e0d6 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:00.384697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb9df2-4a5f-4deb-a528-394b9200e0d6 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:00.389575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:00.390212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:00.390500 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:00.390772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] PATH_INFO: `/v3/users/16eec85213f8418da7ebe0665b8f9b10` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:00.392240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16eec85213f8418da7ebe0665b8f9b10)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:00.395147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:00.572574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:00.592022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16eec85213f8418da7ebe0665b8f9b10'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:00.603795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16eec85213f8418da7ebe0665b8f9b10'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:00.604517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16eec85213f8418da7ebe0665b8f9b10'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:00.612792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16eec85213f8418da7ebe0665b8f9b10'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:00.714278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16eec85213f8418da7ebe0665b8f9b10'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:00.721364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1176/2348] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:00 2022] DELETE /identity/v3/users/16eec85213f8418da7ebe0665b8f9b10 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:00.726191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:00.729118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:00.729118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:00.745671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:00.746911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:00.806376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1173/2349] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:00.816404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:00.818583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:00.879453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1fb07-c792-42db-9f2f-cf80b8c51809 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:00.883650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:00.885866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:00.885866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:00.885866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:00.895788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:00.897307 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:00.908168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1177/2350] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:01.444513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:01.446539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:01.460142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a9da0-6cad-4f6d-b31f-b3b67b2434c2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:01.465147 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:01.465798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:01.466099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:01.467231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] PATH_INFO: `/v3/projects/209a5fbcde7544c7b036678da602644c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:01.468851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209a5fbcde7544c7b036678da602644c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:01.472445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:01.692183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209a5fbcde7544c7b036678da602644c', 'request_id': 'req-68d99481-6d14-4ec0-83aa-bf3ade48be61'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:01.700184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209a5fbcde7544c7b036678da602644c', 'request_id': 'req-68d99481-6d14-4ec0-83aa-bf3ade48be61'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:01.707436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209a5fbcde7544c7b036678da602644c', 'request_id': 'req-68d99481-6d14-4ec0-83aa-bf3ade48be61'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:01.827996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] The token cache is being invalidate because project 209a5fbcde7544c7b036678da602644c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:01.828723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:01.829142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:01.836878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1174/2351] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:01 2022] DELETE /identity/v3/projects/209a5fbcde7544c7b036678da602644c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:01.838327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:01.850357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955e19-ba26-4d29-a2a9-33882aa843aa service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:01.922803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:01.923787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:01.924116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:01.924489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] PATH_INFO: `/v3/users/32b6b0b20ee14619a52f693765300ffa` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:01.925871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b6b0b20ee14619a52f693765300ffa)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:01.928232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:02.126420 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b6b0b20ee14619a52f693765300ffa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:02.137049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:02.146077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b6b0b20ee14619a52f693765300ffa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:02.146832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b6b0b20ee14619a52f693765300ffa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:02.154710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b6b0b20ee14619a52f693765300ffa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:02.282555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0d95d750-0f14-4509-8f14-c484f8b5871e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b6b0b20ee14619a52f693765300ffa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:02.290538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1178/2352] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:01 2022] DELETE /identity/v3/users/32b6b0b20ee14619a52f693765300ffa => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:02.798943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:02.813038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:02.815009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d99481-6d14-4ec0-83aa-bf3ade48be61 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:02.867002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:02.880797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:02.881489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:02.881768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:02.882061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] PATH_INFO: `/v3/projects/0c95702ce30d4271af03be026648463a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:02.883301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c95702ce30d4271af03be026648463a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:02.885553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.089834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c95702ce30d4271af03be026648463a', 'request_id': 'req-792a5dba-8139-406e-8274-4cd42476cdcb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:03.097841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c95702ce30d4271af03be026648463a', 'request_id': 'req-792a5dba-8139-406e-8274-4cd42476cdcb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:03.104604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c95702ce30d4271af03be026648463a', 'request_id': 'req-792a5dba-8139-406e-8274-4cd42476cdcb'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:03.244936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] The token cache is being invalidate because project 0c95702ce30d4271af03be026648463a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:03.245256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:03.245909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-792a5dba-8139-406e-8274-4cd42476cdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:03.247957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1175/2353] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:02 2022] DELETE /identity/v3/projects/0c95702ce30d4271af03be026648463a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:03.253206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063291aa-8bd6-4cb9-9fc3-929e5ce9c298 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.253695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063291aa-8bd6-4cb9-9fc3-929e5ce9c298 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.253810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063291aa-8bd6-4cb9-9fc3-929e5ce9c298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.275425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-063291aa-8bd6-4cb9-9fc3-929e5ce9c298 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:03.276649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-063291aa-8bd6-4cb9-9fc3-929e5ce9c298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:03.338702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1179/2354] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:03.347105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ec04a-484d-4298-842e-b6a95933b01e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.347413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ec04a-484d-4298-842e-b6a95933b01e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.347815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ec04a-484d-4298-842e-b6a95933b01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.370123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-193ec04a-484d-4298-842e-b6a95933b01e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:03.371371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-193ec04a-484d-4298-842e-b6a95933b01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:03.380297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1176/2355] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:03.385432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063291aa-8bd6-4cb9-9fc3-929e5ce9c298 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:03.397710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063291aa-8bd6-4cb9-9fc3-929e5ce9c298 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:03.402919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:03.403591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.404200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.404559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.405394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:03.405612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:03.407262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.420244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1180/2356] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:03.425431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ec04a-484d-4298-842e-b6a95933b01e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:03.437090 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ec04a-484d-4298-842e-b6a95933b01e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:03.443536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:03.444159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.444468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.444745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.445431 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:03.447508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.586893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1177/2357] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:03.591508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:03.602317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f25eed-3c43-4dab-90cb-b69b69644065 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:03.664184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:03.664804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.665107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.665383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.666036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:03.667995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.728833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:03.730650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:03.770121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1181/2358] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:03 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:03.773929 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:03.784058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a6449-a256-4a99-b864-ed75e97fb38f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:03.789228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:03.789871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.790143 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.790423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.791109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:03.792765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.806539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1182/2359] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:03.810757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:03.819281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91972f2-ce39-4452-9188-6c5b1fc9d635 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:03.822234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759621e-a427-4ceb-8f73-7b4dcc367351 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:03.825644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6036c0e-463c-4412-9137-ad51ad709e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:03.826313 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036c0e-463c-4412-9137-ad51ad709e63 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.826612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036c0e-463c-4412-9137-ad51ad709e63 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.826912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036c0e-463c-4412-9137-ad51ad709e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.827564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:03.828208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.828449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.828720 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.828917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d6036c0e-463c-4412-9137-ad51ad709e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:03.829776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:03.831021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.845212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1183/2360] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:03.851137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:03.866218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc09b4-8ae2-4a39-905a-622c0a207bdc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:03.874939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:03.876277 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:03.876580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:03.877153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] PATH_INFO: `/v3/projects/99935eb51aab467aa122321da923ddc4/users/e735d05f06b1429eb0013289ac1847e6/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:03.887494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:03.900968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99935eb51aab467aa122321da923ddc4, user_id=e735d05f06b1429eb0013289ac1847e6, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:03.901715 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6036c0e-463c-4412-9137-ad51ad709e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:03.903299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6036c0e-463c-4412-9137-ad51ad709e63 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.903860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:03.913930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1178/2361] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:04.030388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:04.035792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1184/2362] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:03 2022] PUT /identity/v3/projects/99935eb51aab467aa122321da923ddc4/users/e735d05f06b1429eb0013289ac1847e6/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:04.048752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06607c7-752d-4aa0-ad4f-fdd6ba812242 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.048752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06607c7-752d-4aa0-ad4f-fdd6ba812242 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.049189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06607c7-752d-4aa0-ad4f-fdd6ba812242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.086758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f06607c7-752d-4aa0-ad4f-fdd6ba812242 None None] MFA Rules not processed for user `e735d05f06b1429eb0013289ac1847e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:04.088031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f06607c7-752d-4aa0-ad4f-fdd6ba812242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:04.160043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1179/2363] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:04.164631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:04.229413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa60f5-082c-460b-8dc0-bdfe1fae0e65 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:04.234890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:04.235499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.235893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.236050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.236887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:04.238646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:04.347476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1185/2364] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:04 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:04.351879 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06607c7-752d-4aa0-ad4f-fdd6ba812242 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:04.363955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06607c7-752d-4aa0-ad4f-fdd6ba812242 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:04.424616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:04.425219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.425504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.425780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.426491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:04.428458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:04.537330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1180/2365] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:04 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:04.540004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:04.553305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e17c78-4e64-4f82-875d-f466287fdd29 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:04.558853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:04.559897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.560313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.560731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.561714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:04.563782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:04.578593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1186/2366] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:04.582933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:04.597395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a380ac-deaf-405a-ae16-6d1529a5bf62 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:04.600258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:04.600938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.601257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.601536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] PATH_INFO: `/v3/projects/2af79bd928d64cf79b9f834fbec13690/users/2425a67504bd4bca8b50392ecf1cd1ab/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.623528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af79bd928d64cf79b9f834fbec13690, user_id=2425a67504bd4bca8b50392ecf1cd1ab, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:04.630094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:04.724421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1181/2367] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:04 2022] PUT /identity/v3/projects/2af79bd928d64cf79b9f834fbec13690/users/2425a67504bd4bca8b50392ecf1cd1ab/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:04.728852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:04.740833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe951-d011-4098-a432-dc25b859e8fe admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:04.813559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23bd7-d880-4653-aba2-ffc1d3479c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:04.814295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23bd7-d880-4653-aba2-ffc1d3479c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.814547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23bd7-d880-4653-aba2-ffc1d3479c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.814771 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23bd7-d880-4653-aba2-ffc1d3479c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.815357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23bd7-d880-4653-aba2-ffc1d3479c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:04.817023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23bd7-d880-4653-aba2-ffc1d3479c2d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:04.828699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1187/2368] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:04.835074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:04.844270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c9ee-2a4f-47d0-9e04-aadfca480145 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:04.849712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:04.850368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.850645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.850938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] PATH_INFO: `/v3/projects/2af79bd928d64cf79b9f834fbec13690/users/2425a67504bd4bca8b50392ecf1cd1ab/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.853361 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af79bd928d64cf79b9f834fbec13690, user_id=2425a67504bd4bca8b50392ecf1cd1ab, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:04.856458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:04.871812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1182/2369] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:04 2022] PUT /identity/v3/projects/2af79bd928d64cf79b9f834fbec13690/users/2425a67504bd4bca8b50392ecf1cd1ab/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:04.881305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63598e96-91d2-435b-b100-9c0de41fe201 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:04.881479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63598e96-91d2-435b-b100-9c0de41fe201 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:04.881745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63598e96-91d2-435b-b100-9c0de41fe201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:04.919325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-63598e96-91d2-435b-b100-9c0de41fe201 None None] MFA Rules not processed for user `2425a67504bd4bca8b50392ecf1cd1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:04.920545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-63598e96-91d2-435b-b100-9c0de41fe201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:04.995611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:05.016847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1188/2370] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:05.025318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:05.027400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:05.060808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:05.090032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee762-d91b-47de-84dc-a48a3fd808aa admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:05.094009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:05.094615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:05.094893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:05.095164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:05.157456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:05.158977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:05.168097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1183/2371] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:08.347273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63598e96-91d2-435b-b100-9c0de41fe201 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:08.403505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:08.405350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:08.422580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63598e96-91d2-435b-b100-9c0de41fe201 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:08.427963 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:08.428540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:08.428816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:08.429115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] PATH_INFO: `/v3/users/e735d05f06b1429eb0013289ac1847e6` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:08.430337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e735d05f06b1429eb0013289ac1847e6)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:08.432354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:08.487381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a758b9-6e35-4252-9398-15b7dc0c2783 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:08.492643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:08.493309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:08.493619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:08.493895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] PATH_INFO: `/v3/users/6abe7757171542be8107b4cbd26f06a0` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:08.495149 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6abe7757171542be8107b4cbd26f06a0)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:08.497046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:08.648411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e735d05f06b1429eb0013289ac1847e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.661530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e735d05f06b1429eb0013289ac1847e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.662227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e735d05f06b1429eb0013289ac1847e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.669768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e735d05f06b1429eb0013289ac1847e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.717298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6abe7757171542be8107b4cbd26f06a0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.725215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b8d31e9f-0321-4d33-8116-25c42cb64e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e735d05f06b1429eb0013289ac1847e6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.730211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6abe7757171542be8107b4cbd26f06a0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.732919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1189/2372] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:08 2022] DELETE /identity/v3/users/e735d05f06b1429eb0013289ac1847e6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:08.736817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:08.737180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:08.737461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:08.738498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6abe7757171542be8107b4cbd26f06a0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.756956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:08.758208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:08.805544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6abe7757171542be8107b4cbd26f06a0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.806356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2695699a-d654-48ec-85f4-13373c512f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6abe7757171542be8107b4cbd26f06a0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:08.809634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:08.815267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1184/2373] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:08 2022] DELETE /identity/v3/users/6abe7757171542be8107b4cbd26f06a0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:08.819968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1190/2374] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:08.820374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb6695-14bb-4199-b81e-7305e8686122 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:08.822080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb6695-14bb-4199-b81e-7305e8686122 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:08.822080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb6695-14bb-4199-b81e-7305e8686122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:08.832510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:08.833996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:08.843237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-28fb6695-14bb-4199-b81e-7305e8686122 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:08.844598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-28fb6695-14bb-4199-b81e-7305e8686122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:08.858729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:08.898249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd623-5797-4046-a13c-5e9be0a4d97c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:08.909541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1185/2375] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:08.918886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb6695-14bb-4199-b81e-7305e8686122 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:08.950132 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:08.952943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:08.952943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:08.952943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:08.962526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:08.963965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:08.975521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1191/2376] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:08.979713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb6695-14bb-4199-b81e-7305e8686122 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:08.984479 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:08.985144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:08.985422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:08.985800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:08.997006 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:08.998531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:09.018009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1186/2377] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:09.502519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:09.502519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:09.514306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6b7e-458d-4067-94b2-2aaf9c751a05 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:09.519486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:09.520135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:09.520660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:09.521111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] PATH_INFO: `/v3/projects/99935eb51aab467aa122321da923ddc4` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:09.522138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99935eb51aab467aa122321da923ddc4)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:09.524059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:09.557905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:09.559411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:09.573143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6798b-80d0-40d3-9b51-913de6d2ee7d service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:09.579081 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:09.579737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:09.580018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:09.580290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] PATH_INFO: `/v3/projects/72fcef54e53249908cfe42e1e569a01a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:09.581578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72fcef54e53249908cfe42e1e569a01a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:09.583801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:09.647278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99935eb51aab467aa122321da923ddc4', 'request_id': 'req-93c184a6-bc1b-410f-8afb-b6b1a6491173'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.728109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72fcef54e53249908cfe42e1e569a01a', 'request_id': 'req-27a5d789-190c-417c-8e82-a399fda247c1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.739323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99935eb51aab467aa122321da923ddc4', 'request_id': 'req-93c184a6-bc1b-410f-8afb-b6b1a6491173'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.739779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72fcef54e53249908cfe42e1e569a01a', 'request_id': 'req-27a5d789-190c-417c-8e82-a399fda247c1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.746616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99935eb51aab467aa122321da923ddc4', 'request_id': 'req-93c184a6-bc1b-410f-8afb-b6b1a6491173'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.746758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72fcef54e53249908cfe42e1e569a01a', 'request_id': 'req-27a5d789-190c-417c-8e82-a399fda247c1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.760444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] The token cache is being invalidate because project 99935eb51aab467aa122321da923ddc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:09.760821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.761546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.763262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1192/2378] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:09 2022] DELETE /identity/v3/projects/99935eb51aab467aa122321da923ddc4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:09.767659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:09.769689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:09.839583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:09.843613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c184a6-bc1b-410f-8afb-b6b1a6491173 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:09.905515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:09.906436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:09.906888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:09.907160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] PATH_INFO: `/v3/users/2425a67504bd4bca8b50392ecf1cd1ab` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:09.908426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2425a67504bd4bca8b50392ecf1cd1ab)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:09.910478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:09.914867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] The token cache is being invalidate because project 72fcef54e53249908cfe42e1e569a01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:09.914867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.914867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:09.914867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1187/2379] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:09 2022] DELETE /identity/v3/projects/72fcef54e53249908cfe42e1e569a01a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:09.917397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:09.918674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:09.932644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d789-190c-417c-8e82-a399fda247c1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:09.938483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:09.939129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:09.939410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:09.939684 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] PATH_INFO: `/v3/users/79ee3ffd53aa473aa8646665473529f6` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:09.940841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ee3ffd53aa473aa8646665473529f6)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:09.942826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:09.967206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:10.158164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2425a67504bd4bca8b50392ecf1cd1ab'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.170058 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2425a67504bd4bca8b50392ecf1cd1ab'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.170812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2425a67504bd4bca8b50392ecf1cd1ab'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.178176 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2425a67504bd4bca8b50392ecf1cd1ab'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.204453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ee3ffd53aa473aa8646665473529f6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.224251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ee3ffd53aa473aa8646665473529f6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.237186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ee3ffd53aa473aa8646665473529f6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.250857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2425a67504bd4bca8b50392ecf1cd1ab'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.257986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1193/2380] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:09 2022] DELETE /identity/v3/users/2425a67504bd4bca8b50392ecf1cd1ab => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:10.336453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ee3ffd53aa473aa8646665473529f6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.337108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ee3ffd53aa473aa8646665473529f6'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:10.343733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1188/2381] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:09 2022] DELETE /identity/v3/users/79ee3ffd53aa473aa8646665473529f6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:10.824019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:10.825611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:10.871777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:10.873881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:10.944682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4bd3c-cc7d-4d60-969f-44f28017e2f4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:10.988000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:11.001247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e3520-dd87-42d2-aaa1-756daeb34364 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.006353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.007063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.007348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.007624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] PATH_INFO: `/v3/projects/64e452ce2f2747b6a2df73a1dbd4b83f` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.008806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e452ce2f2747b6a2df73a1dbd4b83f)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.010816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.040492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.041408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.041690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.041967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] PATH_INFO: `/v3/projects/2af79bd928d64cf79b9f834fbec13690` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.043128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af79bd928d64cf79b9f834fbec13690)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.045707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.130447 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e452ce2f2747b6a2df73a1dbd4b83f', 'request_id': 'req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.136281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e452ce2f2747b6a2df73a1dbd4b83f', 'request_id': 'req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.147638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e452ce2f2747b6a2df73a1dbd4b83f', 'request_id': 'req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.198941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af79bd928d64cf79b9f834fbec13690', 'request_id': 'req-7251f95e-24f3-419a-ae40-26d089c10f15'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.233546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] The token cache is being invalidate because project 64e452ce2f2747b6a2df73a1dbd4b83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:11.233849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.234504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-56dbbbe7-6f5d-4aa2-808a-a8c1cd5ad8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.236028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1189/2382] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:10 2022] DELETE /identity/v3/projects/64e452ce2f2747b6a2df73a1dbd4b83f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:11.241121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c798dad-7138-4253-97dc-39e5a3c12743 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.241411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c798dad-7138-4253-97dc-39e5a3c12743 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.241691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c798dad-7138-4253-97dc-39e5a3c12743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.262502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1c798dad-7138-4253-97dc-39e5a3c12743 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:11.264289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1c798dad-7138-4253-97dc-39e5a3c12743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:11.288095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af79bd928d64cf79b9f834fbec13690', 'request_id': 'req-7251f95e-24f3-419a-ae40-26d089c10f15'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.290601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:11.294724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af79bd928d64cf79b9f834fbec13690', 'request_id': 'req-7251f95e-24f3-419a-ae40-26d089c10f15'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.307822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] The token cache is being invalidate because project 2af79bd928d64cf79b9f834fbec13690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:11.308242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.309139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7251f95e-24f3-419a-ae40-26d089c10f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:11.310621 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1194/2383] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:10 2022] DELETE /identity/v3/projects/2af79bd928d64cf79b9f834fbec13690 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:11.315473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56451de-82a3-4f21-bb90-811504d6b1ca None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.315748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56451de-82a3-4f21-bb90-811504d6b1ca None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.316019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56451de-82a3-4f21-bb90-811504d6b1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.331272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1190/2384] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:11.336757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f56451de-82a3-4f21-bb90-811504d6b1ca None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:11.338060 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f56451de-82a3-4f21-bb90-811504d6b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:11.341534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49af8-e3a6-46fa-bebd-262ad3f3f4b6 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.341840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49af8-e3a6-46fa-bebd-262ad3f3f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.342107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49af8-e3a6-46fa-bebd-262ad3f3f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.347491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1195/2385] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:11.360459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f94c-2a07-40bc-abfd-2beccaba994d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.360743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f94c-2a07-40bc-abfd-2beccaba994d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.361015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f94c-2a07-40bc-abfd-2beccaba994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.362458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-23e49af8-e3a6-46fa-bebd-262ad3f3f4b6 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:11.363678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-23e49af8-e3a6-46fa-bebd-262ad3f3f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:11.372154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1191/2386] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:11.376267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49af8-e3a6-46fa-bebd-262ad3f3f4b6 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.380871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-d271f94c-2a07-40bc-abfd-2beccaba994d None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:11.385477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d271f94c-2a07-40bc-abfd-2beccaba994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:11.385615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49af8-e3a6-46fa-bebd-262ad3f3f4b6 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.390799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796963b-de02-477d-b528-81c353524664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.390969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1196/2387] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:11.391489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796963b-de02-477d-b528-81c353524664 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.391842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796963b-de02-477d-b528-81c353524664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.392123 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796963b-de02-477d-b528-81c353524664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.392778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796963b-de02-477d-b528-81c353524664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:11.393130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796963b-de02-477d-b528-81c353524664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.395069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f94c-2a07-40bc-abfd-2beccaba994d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.395188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796963b-de02-477d-b528-81c353524664 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.404895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f94c-2a07-40bc-abfd-2beccaba994d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.408140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1192/2388] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:37:11.411261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.412116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.412399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.412679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.413464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:11.413856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.414571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796963b-de02-477d-b528-81c353524664 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.415478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.424653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796963b-de02-477d-b528-81c353524664 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.431104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1197/2389] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:37:11.432233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.433285 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.433908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.437434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.437434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.437434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.437434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.443508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50281df6-6bf0-4004-98a8-fc8c4ac5364d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.448266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.448920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.449233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.449504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.450143 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.452509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.598888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1193/2390] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:11.599848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1198/2391] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:11.603778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.605393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.671175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aa113-ce45-4142-aae7-f89ddf7d08e8 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.676200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.676816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.677114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.677392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.678035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.679962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.683753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfbdd4-eebb-485f-addb-84bfcf42b15c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.689240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.690471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.690767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.691036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.691705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.693805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.805411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1199/2392] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:11.805671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1194/2393] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:11 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:11.810087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.810594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.817218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:11.821012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83d96d-ea03-4f53-8308-a0b7d322e89a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.822685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7cd4-62cd-4e62-9a84-54903af54896 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.826492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.827106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.827393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.827668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.833026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.833559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.833655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.833655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.833655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.833921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.834014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.834014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.841365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1195/2394] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:11.845200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1200/2395] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:11.845368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.846816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.857906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6dbe-dccb-45fa-b70d-88f852b7284e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.858167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5551db-4955-4f44-8da7-d3952f1d034b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.863070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.863515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.863688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.863973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.864075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.866982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.867096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.867096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.867292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.867383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.867559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.867652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.879389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1196/2396] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:11.880162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1201/2397] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:11.883417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.883576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:11.893312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e775304-40b7-46f2-8e6c-f39ad62b5949 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.893528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ee04-839f-4186-872f-07b0d2c735b8 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:11.898198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f741-03d9-4d6f-b320-3d4a8c9446ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.898794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f741-03d9-4d6f-b320-3d4a8c9446ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.901267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370947-8f27-4edf-bc86-b87ec98910ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:11.901448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f741-03d9-4d6f-b320-3d4a8c9446ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.901448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f741-03d9-4d6f-b320-3d4a8c9446ec admin admin] PATH_INFO: `/v3/projects/7261fbf2460044e6a5c2b82c8a87aa79/users/7e3516f48b0e40ea98d0c3d00cc91438/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.901707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370947-8f27-4edf-bc86-b87ec98910ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:11.901707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370947-8f27-4edf-bc86-b87ec98910ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:11.901707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370947-8f27-4edf-bc86-b87ec98910ab admin admin] PATH_INFO: `/v3/projects/8d95718f20e6425fa968e6f8f23d14e4/users/5039be557cac46fa917a062148d01abf/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:11.915149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61f741-03d9-4d6f-b320-3d4a8c9446ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7261fbf2460044e6a5c2b82c8a87aa79, user_id=7e3516f48b0e40ea98d0c3d00cc91438, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.917230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370947-8f27-4edf-bc86-b87ec98910ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d95718f20e6425fa968e6f8f23d14e4, user_id=5039be557cac46fa917a062148d01abf, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:11.917829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61f741-03d9-4d6f-b320-3d4a8c9446ec admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:11.920444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370947-8f27-4edf-bc86-b87ec98910ab admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.001412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1202/2398] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:11 2022] PUT /identity/v3/projects/7261fbf2460044e6a5c2b82c8a87aa79/users/7e3516f48b0e40ea98d0c3d00cc91438/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:12.011986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310e2a4-5edd-4f27-93c1-11256f77db1a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.012279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310e2a4-5edd-4f27-93c1-11256f77db1a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.012661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1197/2399] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:11 2022] PUT /identity/v3/projects/8d95718f20e6425fa968e6f8f23d14e4/users/5039be557cac46fa917a062148d01abf/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:12.012808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310e2a4-5edd-4f27-93c1-11256f77db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.018814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.019210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.019665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.039440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:12.040659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:12.040779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5310e2a4-5edd-4f27-93c1-11256f77db1a None None] MFA Rules not processed for user `7e3516f48b0e40ea98d0c3d00cc91438`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:12.042023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5310e2a4-5edd-4f27-93c1-11256f77db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:12.068045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:12.106183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1198/2400] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:12.114556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1203/2401] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:12.117675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.119068 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:12.124497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310e2a4-5edd-4f27-93c1-11256f77db1a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.136273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310e2a4-5edd-4f27-93c1-11256f77db1a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:12.142190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:12.143254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.148870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.148870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.148870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:12.148870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.190273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe3c3-7cf6-45a9-bcb2-a0b1b62ac625 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:12.193980 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:12.194647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.194931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.195423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.206750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:12.208256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.218405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1199/2402] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:12.298596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1204/2403] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:12 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:12.302771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.313427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8cd68-a148-4a62-a651-3332a5cb3e02 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:12.372404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:12.373368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.373644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.373912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.374562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:12.376478 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.491529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1200/2404] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:12 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:12.495824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.506302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661d6dc-b5a7-448f-b271-4a0bb36ebc10 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:12.511121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:12.511736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.511971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.512241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.512884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:12.514520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.525316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1205/2405] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:12.535590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.546671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2ea5e-ddb3-4ef6-9146-77edb46dd5d4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:12.551659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:12.552458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.552808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.553184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] PATH_INFO: `/v3/projects/681f81b7835f41279ec6151b5cb92e2e/users/1371423cb1854d499f083ab849f06444/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.571293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681f81b7835f41279ec6151b5cb92e2e, user_id=1371423cb1854d499f083ab849f06444, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:12.574212 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.674687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1201/2406] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:12 2022] PUT /identity/v3/projects/681f81b7835f41279ec6151b5cb92e2e/users/1371423cb1854d499f083ab849f06444/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:12.678529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.688443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed6ce-0574-4d50-b18b-4bf66ed29088 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:12.755314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb3a50-22a9-4bf4-b536-00a75f5271d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:12.755933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb3a50-22a9-4bf4-b536-00a75f5271d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.756213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb3a50-22a9-4bf4-b536-00a75f5271d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.756485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb3a50-22a9-4bf4-b536-00a75f5271d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.757309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb3a50-22a9-4bf4-b536-00a75f5271d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:12.758923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb3a50-22a9-4bf4-b536-00a75f5271d1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.775523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1206/2407] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:12.776847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.788505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376efb3-4f96-487a-8606-efb98caad6e7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:12.793933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:12.794639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.794917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.795187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] PATH_INFO: `/v3/projects/681f81b7835f41279ec6151b5cb92e2e/users/1371423cb1854d499f083ab849f06444/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.797170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681f81b7835f41279ec6151b5cb92e2e, user_id=1371423cb1854d499f083ab849f06444, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:12.799977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:12.811666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1202/2408] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:12 2022] PUT /identity/v3/projects/681f81b7835f41279ec6151b5cb92e2e/users/1371423cb1854d499f083ab849f06444/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:12.822158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c0c0-325e-4dc9-8fd8-6ea4b9715da0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:12.822550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c0c0-325e-4dc9-8fd8-6ea4b9715da0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:12.822834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c0c0-325e-4dc9-8fd8-6ea4b9715da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:12.846733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:12.860084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4173c0c0-325e-4dc9-8fd8-6ea4b9715da0 None None] MFA Rules not processed for user `1371423cb1854d499f083ab849f06444`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:12.861184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4173c0c0-325e-4dc9-8fd8-6ea4b9715da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:12.932929 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1207/2409] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:12.944449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:12.946206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:12.982108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:13.011838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366113-8a88-4153-85aa-6c7f43825453 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:13.016287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:13.016917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:13.017248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:13.017542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:13.078511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:13.079959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:13.089954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1203/2410] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:13.626766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fac6-519e-4e84-a811-256138689bd1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:13.627052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fac6-519e-4e84-a811-256138689bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:13.627324 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fac6-519e-4e84-a811-256138689bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:13.660138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-82a4fac6-519e-4e84-a811-256138689bd1 None None] MFA Rules not processed for user `5039be557cac46fa917a062148d01abf`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:13.661391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-82a4fac6-519e-4e84-a811-256138689bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:13.729463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1208/2411] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:13.740832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:13.742366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:13.755211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c41ee1-6369-480a-99d2-dc1ef22f3ff9 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:13.759330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e59db-b86b-40d3-888f-24476f7808c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:13.759928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e59db-b86b-40d3-888f-24476f7808c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:13.764746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e59db-b86b-40d3-888f-24476f7808c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:13.764746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e59db-b86b-40d3-888f-24476f7808c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:13.769981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e59db-b86b-40d3-888f-24476f7808c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:13.771408 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e59db-b86b-40d3-888f-24476f7808c5 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:13.780891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1204/2412] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:14.879337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fac6-519e-4e84-a811-256138689bd1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:14.889304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fac6-519e-4e84-a811-256138689bd1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:14.892926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:14.893567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:14.893844 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:14.894114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:14.903147 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:14.904574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:14.914227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1209/2413] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:15.560383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc26a-453f-4e10-aba4-61a5e1260e2e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:15.560383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc26a-453f-4e10-aba4-61a5e1260e2e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:15.560383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc26a-453f-4e10-aba4-61a5e1260e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:15.576157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-cdfcc26a-453f-4e10-aba4-61a5e1260e2e None None] MFA Rules not processed for user `5039be557cac46fa917a062148d01abf`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:15.577392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-cdfcc26a-453f-4e10-aba4-61a5e1260e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:15.584644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1205/2414] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:19.370252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:19.447206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d073e9-80be-49e8-9d51-2919a37d79f7 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:19.455003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:19.456062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:19.456524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:19.457014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] PATH_INFO: `/v3/users/7e3516f48b0e40ea98d0c3d00cc91438` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:19.458926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3516f48b0e40ea98d0c3d00cc91438)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:19.463681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:19.484163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:19.737898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3516f48b0e40ea98d0c3d00cc91438'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:19.751496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3516f48b0e40ea98d0c3d00cc91438'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:19.752240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3516f48b0e40ea98d0c3d00cc91438'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:19.760061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3516f48b0e40ea98d0c3d00cc91438'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:19.835980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3516f48b0e40ea98d0c3d00cc91438'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:19.844911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1210/2415] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:19 2022] DELETE /identity/v3/users/7e3516f48b0e40ea98d0c3d00cc91438 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:19.865087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:19.865839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:19.865839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:19.892606 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:19.894093 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:19.975150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1206/2416] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:19.988018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:19.989558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:20.056044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cdfb5-b266-4936-aee0-e91a27173c67 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:20.063865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:20.064496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:20.064778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:20.065049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:20.075749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:20.077214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:20.087950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1211/2417] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:20.738570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:20.740901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:20.764440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4702b-1c1c-419d-bc07-65aba65d4431 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:20.773618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:20.774708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:20.775529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:20.776317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] PATH_INFO: `/v3/projects/7261fbf2460044e6a5c2b82c8a87aa79` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:20.781264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7261fbf2460044e6a5c2b82c8a87aa79)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:20.785369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:20.921511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7261fbf2460044e6a5c2b82c8a87aa79', 'request_id': 'req-64892ee0-135f-47e5-acf1-aa2ed1be5214'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:20.928924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:20.930350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7261fbf2460044e6a5c2b82c8a87aa79', 'request_id': 'req-64892ee0-135f-47e5-acf1-aa2ed1be5214'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:20.937007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7261fbf2460044e6a5c2b82c8a87aa79', 'request_id': 'req-64892ee0-135f-47e5-acf1-aa2ed1be5214'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.017698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] The token cache is being invalidate because project 7261fbf2460044e6a5c2b82c8a87aa79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:21.018079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.018893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.020538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1207/2418] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:20 2022] DELETE /identity/v3/projects/7261fbf2460044e6a5c2b82c8a87aa79 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:21.024851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:21.036893 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d6bc3-8848-4452-90fe-d66f71f8b175 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:21.104371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:21.105008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:21.105321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:21.105593 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] PATH_INFO: `/v3/users/1371423cb1854d499f083ab849f06444` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:21.106961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1371423cb1854d499f083ab849f06444)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:21.109923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:21.337840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:21.351327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1371423cb1854d499f083ab849f06444'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.370653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1371423cb1854d499f083ab849f06444'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.372907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1371423cb1854d499f083ab849f06444'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.383408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1371423cb1854d499f083ab849f06444'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.462214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-874b9b98-e79a-48ed-ada4-a85412054015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1371423cb1854d499f083ab849f06444'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:21.469542 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1212/2419] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:21 2022] DELETE /identity/v3/users/1371423cb1854d499f083ab849f06444 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:22.025324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:22.027743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:22.055397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892ee0-135f-47e5-acf1-aa2ed1be5214 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:22.156324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:22.157526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:22.158036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:22.158527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] PATH_INFO: `/v3/projects/681f81b7835f41279ec6151b5cb92e2e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:22.160692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=681f81b7835f41279ec6151b5cb92e2e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:22.164562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:22.364687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681f81b7835f41279ec6151b5cb92e2e', 'request_id': 'req-1e1d8b5a-7f77-40be-a524-3e2270d12892'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:22.370962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681f81b7835f41279ec6151b5cb92e2e', 'request_id': 'req-1e1d8b5a-7f77-40be-a524-3e2270d12892'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:22.383119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681f81b7835f41279ec6151b5cb92e2e', 'request_id': 'req-1e1d8b5a-7f77-40be-a524-3e2270d12892'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:22.840104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] The token cache is being invalidate because project 681f81b7835f41279ec6151b5cb92e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:22.840398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:22.841098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-1e1d8b5a-7f77-40be-a524-3e2270d12892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:22.843199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1208/2420] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:22 2022] DELETE /identity/v3/projects/681f81b7835f41279ec6151b5cb92e2e => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:22.848308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e702b-b2bc-4b68-888a-47be9c9599dd None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:22.848875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e702b-b2bc-4b68-888a-47be9c9599dd None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:22.849164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e702b-b2bc-4b68-888a-47be9c9599dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:22.874690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-134e702b-b2bc-4b68-888a-47be9c9599dd None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:22.875988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-134e702b-b2bc-4b68-888a-47be9c9599dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:22.947674 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1213/2421] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:22.958089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5385-0267-4ebe-b971-36a61f9cd6f4 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:22.959208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5385-0267-4ebe-b971-36a61f9cd6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:22.959492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5385-0267-4ebe-b971-36a61f9cd6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:22.995529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-09de5385-0267-4ebe-b971-36a61f9cd6f4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:22.996674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-09de5385-0267-4ebe-b971-36a61f9cd6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:23.015372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1209/2422] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:23.019522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e702b-b2bc-4b68-888a-47be9c9599dd None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:23.045003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e702b-b2bc-4b68-888a-47be9c9599dd None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:23.045003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:23.045003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.045003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.045541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.045541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:23.045541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:23.045541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:23.065624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1214/2423] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:23.067407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de5385-0267-4ebe-b971-36a61f9cd6f4 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:23.079193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de5385-0267-4ebe-b971-36a61f9cd6f4 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:23.084095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:23.084793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.085180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.085461 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.086942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:23.088264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:23.276626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1210/2424] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:23 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:23.282824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:23.299321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088a857-d59b-4ebd-9b85-c14425e03bd6 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:23.391975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:23.392601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.393189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.393189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.393852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:23.395841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:23.523009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1215/2425] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:23 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:23.524349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:23.536781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf2ec-a22b-4f49-8ddc-513b01254f16 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:23.542025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:23.542778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.543333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.543962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.544721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:23.546613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:23.562958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1211/2426] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:23.564648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:23.577858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4763a3-3ea9-45c0-8475-f80077e78f33 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:23.584006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c4b1-f752-4538-9d15-633969111060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:23.585427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c4b1-f752-4538-9d15-633969111060 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.585427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c4b1-f752-4538-9d15-633969111060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.585427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c4b1-f752-4538-9d15-633969111060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.585946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c4b1-f752-4538-9d15-633969111060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:23.587509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c4b1-f752-4538-9d15-633969111060 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:23.604489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1216/2427] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:23.609653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:23.621098 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45850a3a-f988-43b9-a70a-e1871d4362fe admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:23.627896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:23.628697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.629116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.629544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] PATH_INFO: `/v3/projects/7b9089d927fa406880690d0ec44b85c4/users/ad084be30ca342e19c1d45a5c3e43240/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.649226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9089d927fa406880690d0ec44b85c4, user_id=ad084be30ca342e19c1d45a5c3e43240, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:23.652418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:23.757741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1212/2428] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:23 2022] PUT /identity/v3/projects/7b9089d927fa406880690d0ec44b85c4/users/ad084be30ca342e19c1d45a5c3e43240/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:23.768857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907b8f-5f1d-41a7-8f3e-b11e7c484b4c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.768857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907b8f-5f1d-41a7-8f3e-b11e7c484b4c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.769234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907b8f-5f1d-41a7-8f3e-b11e7c484b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.801542 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c6907b8f-5f1d-41a7-8f3e-b11e7c484b4c None None] MFA Rules not processed for user `ad084be30ca342e19c1d45a5c3e43240`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:23.802805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c6907b8f-5f1d-41a7-8f3e-b11e7c484b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:23.808768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:23.882538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1217/2429] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:23.888638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:23.902404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:23.956849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae22f-8d79-4623-b4bd-a437106915f5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:23.961958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:23.962518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:23.962799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:23.963074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:23.963709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:23.966271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:24.046097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1213/2430] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:24.050835 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6907b8f-5f1d-41a7-8f3e-b11e7c484b4c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:24.065491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6907b8f-5f1d-41a7-8f3e-b11e7c484b4c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:24.149914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:24.150537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:24.150819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:24.151093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:24.151734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:24.153958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:24.283709 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1218/2431] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:24 2022] POST /identity/v3/users => generated 299 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:24.287875 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:24.300532 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029f63f-fbf1-4032-bcb8-897278270029 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:24.306894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:24.307919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:24.308360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:24.308891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:24.310356 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:24.312766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:24.331629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1214/2432] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:24.339690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:24.352182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbed25b-ba76-444a-9e35-b8db0c8535d5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:24.358461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:24.359246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:24.359635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:24.360041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] PATH_INFO: `/v3/projects/0627079adb34430c8ac088487a9564e6/users/3f32405d6f8c442caae45a1533081b73/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:24.378005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0627079adb34430c8ac088487a9564e6, user_id=3f32405d6f8c442caae45a1533081b73, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:24.380673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:24.500372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1219/2433] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:24 2022] PUT /identity/v3/projects/0627079adb34430c8ac088487a9564e6/users/3f32405d6f8c442caae45a1533081b73/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:24.504669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:24.515375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd149-92b4-467b-99f7-13ed6446752f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:24.577283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c803e94-5848-44c2-ad6d-f7c307c2479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:24.577917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803e94-5848-44c2-ad6d-f7c307c2479f admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:24.578174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803e94-5848-44c2-ad6d-f7c307c2479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:24.578445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803e94-5848-44c2-ad6d-f7c307c2479f admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:24.579084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c803e94-5848-44c2-ad6d-f7c307c2479f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:24.580672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c803e94-5848-44c2-ad6d-f7c307c2479f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:24.591802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1215/2434] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:24.596522 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:24.608589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef8e61-936d-4226-a66a-808eeab10490 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:24.613652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:24.614326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:24.614605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:24.614879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] PATH_INFO: `/v3/projects/0627079adb34430c8ac088487a9564e6/users/3f32405d6f8c442caae45a1533081b73/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:24.617220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0627079adb34430c8ac088487a9564e6, user_id=3f32405d6f8c442caae45a1533081b73, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:24.619905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:24.631613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1220/2435] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:24 2022] PUT /identity/v3/projects/0627079adb34430c8ac088487a9564e6/users/3f32405d6f8c442caae45a1533081b73/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:24.643328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b81c-17dd-42ac-bc60-67398096d5a8 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:24.643615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b81c-17dd-42ac-bc60-67398096d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:24.643990 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b81c-17dd-42ac-bc60-67398096d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:24.675999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-44f9b81c-17dd-42ac-bc60-67398096d5a8 None None] MFA Rules not processed for user `3f32405d6f8c442caae45a1533081b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:24.677585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-44f9b81c-17dd-42ac-bc60-67398096d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:24.757306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1216/2436] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:24.777344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:24.779242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:24.862907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064bb41-9d95-4211-a7a7-b48a455f9841 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:24.867670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2582115-4e98-4975-a67d-2848eea2b9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:24.867862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2582115-4e98-4975-a67d-2848eea2b9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:24.868009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2582115-4e98-4975-a67d-2848eea2b9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:24.868284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2582115-4e98-4975-a67d-2848eea2b9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:24.881002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2582115-4e98-4975-a67d-2848eea2b9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:24.882490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2582115-4e98-4975-a67d-2848eea2b9d9 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:24.895815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1221/2437] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:24.982751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9b81c-17dd-42ac-bc60-67398096d5a8 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:24.996604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:25.080968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9b81c-17dd-42ac-bc60-67398096d5a8 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:25.085869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:25.086643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:25.086808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:25.087061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] PATH_INFO: `/v3/users/ad084be30ca342e19c1d45a5c3e43240` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:25.088357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad084be30ca342e19c1d45a5c3e43240)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:25.090549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:25.295304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad084be30ca342e19c1d45a5c3e43240'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:25.308732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad084be30ca342e19c1d45a5c3e43240'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:25.317240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad084be30ca342e19c1d45a5c3e43240'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:25.379284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad084be30ca342e19c1d45a5c3e43240'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:25.380133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad084be30ca342e19c1d45a5c3e43240'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:25.388139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1217/2438] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:24 2022] DELETE /identity/v3/users/ad084be30ca342e19c1d45a5c3e43240 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:25.393632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:25.394103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:25.394563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:25.403050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:25.417935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:25.420356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:25.528656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1222/2439] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:25.532569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:25.536218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:25.636266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88c4d4-32b4-45a7-b382-03eab7facf56 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:25.640881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:25.641804 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:25.642092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:25.642364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:25.653827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:25.655301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:25.667032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1218/2440] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:26.489377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:26.489377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:26.497959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532ba74-e210-4e48-b5aa-e1a77d8c71a1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:26.502927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94113433-36de-4e61-b431-d46144826496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:26.503571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113433-36de-4e61-b431-d46144826496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:26.503840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113433-36de-4e61-b431-d46144826496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:26.504106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113433-36de-4e61-b431-d46144826496 admin admin] PATH_INFO: `/v3/projects/7b9089d927fa406880690d0ec44b85c4` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:26.505271 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94113433-36de-4e61-b431-d46144826496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9089d927fa406880690d0ec44b85c4)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:26.507227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94113433-36de-4e61-b431-d46144826496 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:26.624023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9089d927fa406880690d0ec44b85c4', 'request_id': 'req-94113433-36de-4e61-b431-d46144826496'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:26.713699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9089d927fa406880690d0ec44b85c4', 'request_id': 'req-94113433-36de-4e61-b431-d46144826496'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:26.721426 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9089d927fa406880690d0ec44b85c4', 'request_id': 'req-94113433-36de-4e61-b431-d46144826496'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:26.735158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-94113433-36de-4e61-b431-d46144826496 admin admin] The token cache is being invalidate because project 7b9089d927fa406880690d0ec44b85c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:26.735485 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:26.736152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:26.737741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1223/2441] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:26 2022] DELETE /identity/v3/projects/7b9089d927fa406880690d0ec44b85c4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:26.741988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:26.754735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd29ac5-e932-4763-85e5-b7ba1ba135ed service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:26.790222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:26.845779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:26.846435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:26.846713 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:26.846987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] PATH_INFO: `/v3/users/3f32405d6f8c442caae45a1533081b73` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:26.848346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f32405d6f8c442caae45a1533081b73)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:26.850759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:27.023844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f32405d6f8c442caae45a1533081b73'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:27.038569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f32405d6f8c442caae45a1533081b73'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:27.046764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f32405d6f8c442caae45a1533081b73'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:27.126152 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f32405d6f8c442caae45a1533081b73'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:27.127487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-271f9408-f966-4ebd-827a-fff93eaa6443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f32405d6f8c442caae45a1533081b73'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:27.140699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1219/2442] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:26 2022] DELETE /identity/v3/users/3f32405d6f8c442caae45a1533081b73 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:27.856998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:27.860219 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:27.879185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94113433-36de-4e61-b431-d46144826496 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:27.982405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:27.985665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:27.986204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:27.986589 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] PATH_INFO: `/v3/projects/0627079adb34430c8ac088487a9564e6` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:27.991571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0627079adb34430c8ac088487a9564e6)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:27.997514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:28.095523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:28.125093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0627079adb34430c8ac088487a9564e6', 'request_id': 'req-09d27d45-7aac-49e5-87be-beb1416373ce'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:28.223057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0627079adb34430c8ac088487a9564e6', 'request_id': 'req-09d27d45-7aac-49e5-87be-beb1416373ce'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:28.231305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0627079adb34430c8ac088487a9564e6', 'request_id': 'req-09d27d45-7aac-49e5-87be-beb1416373ce'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:28.252092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] The token cache is being invalidate because project 0627079adb34430c8ac088487a9564e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:28.252746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:28.253866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-09d27d45-7aac-49e5-87be-beb1416373ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:28.255737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1224/2443] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:27 2022] DELETE /identity/v3/projects/0627079adb34430c8ac088487a9564e6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:28.260854 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f638431-ed61-49c1-b4df-7c4a4eaea81c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.261743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f638431-ed61-49c1-b4df-7c4a4eaea81c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.261743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f638431-ed61-49c1-b4df-7c4a4eaea81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.284640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3f638431-ed61-49c1-b4df-7c4a4eaea81c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:28.286076 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3f638431-ed61-49c1-b4df-7c4a4eaea81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:28.382244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1220/2444] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:28.396865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab523f8-2e29-4475-b0ce-c792d468ab6e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.397549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab523f8-2e29-4475-b0ce-c792d468ab6e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.398015 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab523f8-2e29-4475-b0ce-c792d468ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.441276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-7ab523f8-2e29-4475-b0ce-c792d468ab6e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:28.442989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-7ab523f8-2e29-4475-b0ce-c792d468ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:28.460009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1225/2445] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:28.466301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f638431-ed61-49c1-b4df-7c4a4eaea81c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:28.483956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f638431-ed61-49c1-b4df-7c4a4eaea81c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:28.491895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:28.492530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.492815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.493136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.493814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:28.494113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:28.496741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:28.522165 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1221/2446] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:28.535965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab523f8-2e29-4475-b0ce-c792d468ab6e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:28.561431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab523f8-2e29-4475-b0ce-c792d468ab6e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:28.568606 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783fe4-374f-44df-8a46-c82453db8db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:28.576139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783fe4-374f-44df-8a46-c82453db8db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.576139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783fe4-374f-44df-8a46-c82453db8db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.576139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783fe4-374f-44df-8a46-c82453db8db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.576139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48783fe4-374f-44df-8a46-c82453db8db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:28.576139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48783fe4-374f-44df-8a46-c82453db8db8 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:28.681595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1226/2447] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:28 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:28.691585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:28.697054 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ca6a-b716-4103-bc76-aa46bb34815d None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.698121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ca6a-b716-4103-bc76-aa46bb34815d None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.698121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ca6a-b716-4103-bc76-aa46bb34815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.706234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17cdb-70b5-4a70-9c18-a035dfa651e8 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:28.725427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c775ca6a-b716-4103-bc76-aa46bb34815d None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:28.726988 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c775ca6a-b716-4103-bc76-aa46bb34815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:28.760821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:28.792262 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:28.793491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.794216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.794693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.795765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:28.799399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:28.810459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1227/2448] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:28.956242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1222/2449] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:28 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:28.962200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ca6a-b716-4103-bc76-aa46bb34815d None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:28.978646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ca6a-b716-4103-bc76-aa46bb34815d None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:28.987290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:28.988750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.989216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.989907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.990954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:28.993131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:28.994483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:28.995755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:29.028904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1228/2450] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:29.030199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:29.045317 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080c6da-40ac-45d8-99fb-26f33b73c559 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:29.051741 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:29.052214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.052404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.052721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.053463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:29.055546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:29.074207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1229/2451] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:29.081128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:29.089938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7482c2-f7a9-463c-abe7-b7cd276cdf30 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:29.098393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:29.098734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.099167 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.099443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] PATH_INFO: `/v3/projects/ffc3bc5e7da94bd3bb475a014a16209d/users/25689aa912fd4f4db4da5a0a96be03ab/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.141968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc3bc5e7da94bd3bb475a014a16209d, user_id=25689aa912fd4f4db4da5a0a96be03ab, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:29.150037 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:29.181882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf3c2f-9006-4dd2-b9e6-e539f4d9b9ad admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:29.191677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468af5ef-2b2d-4118-94c1-c1a72d9c2109 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:29.192209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af5ef-2b2d-4118-94c1-c1a72d9c2109 service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.192495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af5ef-2b2d-4118-94c1-c1a72d9c2109 service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.192773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af5ef-2b2d-4118-94c1-c1a72d9c2109 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.206829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468af5ef-2b2d-4118-94c1-c1a72d9c2109 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:29.210915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468af5ef-2b2d-4118-94c1-c1a72d9c2109 service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:29.227957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1223/2452] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:37:29.306074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1230/2453] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:29 2022] PUT /identity/v3/projects/ffc3bc5e7da94bd3bb475a014a16209d/users/25689aa912fd4f4db4da5a0a96be03ab/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:29.321127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da35dcd-f450-47ee-9e1d-f62fb172d99a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.321127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da35dcd-f450-47ee-9e1d-f62fb172d99a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.321127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da35dcd-f450-47ee-9e1d-f62fb172d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.372063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-8da35dcd-f450-47ee-9e1d-f62fb172d99a None None] MFA Rules not processed for user `25689aa912fd4f4db4da5a0a96be03ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:29.374549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8da35dcd-f450-47ee-9e1d-f62fb172d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:29.554447 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1224/2454] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:29.555402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:29.663882 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:29.702034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d598d-f7a4-4ea9-8169-e0278d764740 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:29.712139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:29.717383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.717383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.717383 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.718136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:29.723972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:29.985288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1231/2455] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:29 2022] POST /identity/v3/projects => generated 381 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:29.988711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da35dcd-f450-47ee-9e1d-f62fb172d99a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:30.002501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da35dcd-f450-47ee-9e1d-f62fb172d99a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:30.120451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:30.161625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:30.162323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:30.167959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:30.167959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:30.167959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:30.168354 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:30.334795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1225/2456] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:29 2022] POST /identity/v3/users => generated 297 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:30.336025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:30.357418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72e143-d746-4eff-affd-94c0f6b1354b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:30.363986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:30.364716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:30.365091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:30.365490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:30.366300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:30.367991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:30.397112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1232/2457] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:30.398410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:30.423353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421f429-a492-44c0-813b-76f229b021f4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:30.444382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:30.445519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:30.446278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:30.447441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] PATH_INFO: `/v3/projects/e99d4e2207734221a6aecea5ee729357/users/40e377dfd09a46d58fcedbb32a2d1798/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:30.484353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99d4e2207734221a6aecea5ee729357, user_id=40e377dfd09a46d58fcedbb32a2d1798, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:30.493858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:30.624716 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:30.626108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1226/2458] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:30 2022] PUT /identity/v3/projects/e99d4e2207734221a6aecea5ee729357/users/40e377dfd09a46d58fcedbb32a2d1798/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:30.645336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65352-e245-4f5c-87ce-7f9aa28e8d15 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:30.824344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998874b-b5cb-4695-99da-f3057045cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:30.825785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998874b-b5cb-4695-99da-f3057045cc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:30.826291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998874b-b5cb-4695-99da-f3057045cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:30.826791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998874b-b5cb-4695-99da-f3057045cc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:30.827953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998874b-b5cb-4695-99da-f3057045cc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:30.833266 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998874b-b5cb-4695-99da-f3057045cc30 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:30.868369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:30.881170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1233/2459] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:30.915784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4b52-7b80-4a0c-af60-f4ef3e03f574 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:30.926179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:30.927882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:30.928894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:30.929406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] PATH_INFO: `/v3/projects/e99d4e2207734221a6aecea5ee729357/users/40e377dfd09a46d58fcedbb32a2d1798/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:30.934003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99d4e2207734221a6aecea5ee729357, user_id=40e377dfd09a46d58fcedbb32a2d1798, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:30.938927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:30.998291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1227/2460] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:30 2022] PUT /identity/v3/projects/e99d4e2207734221a6aecea5ee729357/users/40e377dfd09a46d58fcedbb32a2d1798/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:31.023753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4be8ed-aae7-424c-b6b0-cb717e8762db None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:31.026233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4be8ed-aae7-424c-b6b0-cb717e8762db None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:31.027539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4be8ed-aae7-424c-b6b0-cb717e8762db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:31.100796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1d4be8ed-aae7-424c-b6b0-cb717e8762db None None] MFA Rules not processed for user `40e377dfd09a46d58fcedbb32a2d1798`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:31.103012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1d4be8ed-aae7-424c-b6b0-cb717e8762db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:31.303087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1234/2461] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:31.318909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:31.321987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:31.428836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5d29c-5bab-4d77-84f8-6cd59325b5cb admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:31.435711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:31.436623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:31.437164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:31.437529 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:31.454187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:31.457099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:31.479288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1228/2462] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:31.673508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4be8ed-aae7-424c-b6b0-cb717e8762db None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:31.693242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4be8ed-aae7-424c-b6b0-cb717e8762db None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:31.699932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c31de-469f-480e-9194-771c2139039f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:31.700896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c31de-469f-480e-9194-771c2139039f service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:31.701448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c31de-469f-480e-9194-771c2139039f service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:31.702008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c31de-469f-480e-9194-771c2139039f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:31.787471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:31.811380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c31de-469f-480e-9194-771c2139039f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:31.813241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c31de-469f-480e-9194-771c2139039f service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:31.837168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1235/2463] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:37.084053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:37.187801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3672e-2b24-4e5b-ac5e-c33e1e2225bc service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:37.194258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:37.195005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:37.195289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:37.195564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] PATH_INFO: `/v3/users/25689aa912fd4f4db4da5a0a96be03ab` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:37.197033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25689aa912fd4f4db4da5a0a96be03ab)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:37.199073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:37.460858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:37.481981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25689aa912fd4f4db4da5a0a96be03ab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:37.497233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25689aa912fd4f4db4da5a0a96be03ab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:37.505667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25689aa912fd4f4db4da5a0a96be03ab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:37.819567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25689aa912fd4f4db4da5a0a96be03ab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:37.820443 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25689aa912fd4f4db4da5a0a96be03ab'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:37.829452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1229/2464] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:37 2022] DELETE /identity/v3/users/25689aa912fd4f4db4da5a0a96be03ab => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:37.834484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:37.835472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:37.835935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:37.858940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:37.860385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:38.146809 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1236/2465] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:38.163934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:38.165372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:38.270899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d810-f537-448e-b40a-c9b5e445cb37 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:38.270899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:38.270899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:38.271898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:38.271898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:38.288411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:38.290228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:38.303316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1230/2466] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:39.181717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:39.184038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:39.208662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08be4e-cc03-4784-bcde-c11930756e6e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:39.215102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:39.218767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:39.219311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:39.219820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] PATH_INFO: `/v3/projects/ffc3bc5e7da94bd3bb475a014a16209d` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:39.222183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc3bc5e7da94bd3bb475a014a16209d)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:39.231484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:39.386648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc3bc5e7da94bd3bb475a014a16209d', 'request_id': 'req-1fa0c12e-6037-40e0-a3a9-b449c3d20722'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:39.487922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc3bc5e7da94bd3bb475a014a16209d', 'request_id': 'req-1fa0c12e-6037-40e0-a3a9-b449c3d20722'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:39.495972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc3bc5e7da94bd3bb475a014a16209d', 'request_id': 'req-1fa0c12e-6037-40e0-a3a9-b449c3d20722'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:39.522289 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] The token cache is being invalidate because project ffc3bc5e7da94bd3bb475a014a16209d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:39.522944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:39.523880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:39.526088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1237/2467] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:39 2022] DELETE /identity/v3/projects/ffc3bc5e7da94bd3bb475a014a16209d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:39.530631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:39.541983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7cd12-c78f-4da5-ab7d-301ef7ba1cee service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:39.636222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:39.636929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:39.638075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:39.638439 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] PATH_INFO: `/v3/users/40e377dfd09a46d58fcedbb32a2d1798` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:39.639883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e377dfd09a46d58fcedbb32a2d1798)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:39.642047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:39.881899 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e377dfd09a46d58fcedbb32a2d1798'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:39.900474 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:39.904050 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e377dfd09a46d58fcedbb32a2d1798'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:39.916740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e377dfd09a46d58fcedbb32a2d1798'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:40.033487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e377dfd09a46d58fcedbb32a2d1798'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:40.033487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e377dfd09a46d58fcedbb32a2d1798'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:40.039333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:40.042199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:40.054516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1231/2468] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:39 2022] DELETE /identity/v3/users/40e377dfd09a46d58fcedbb32a2d1798 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:40.182577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c12e-6037-40e0-a3a9-b449c3d20722 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:40.213885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:40.269641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ac2b7-f59b-41cd-8037-89378ccd0305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:40.270362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac2b7-f59b-41cd-8037-89378ccd0305 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:40.270807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac2b7-f59b-41cd-8037-89378ccd0305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:40.271293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac2b7-f59b-41cd-8037-89378ccd0305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:40.273425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-153ac2b7-f59b-41cd-8037-89378ccd0305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:40.386460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ac2b7-f59b-41cd-8037-89378ccd0305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:40.388472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ac2b7-f59b-41cd-8037-89378ccd0305 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:40.401388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1238/2469] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:41.232261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:41.233288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:41.257469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0617bb7-f8c4-4552-b056-a7daa7085e5b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:41.275664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:41.276708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.277213 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.277942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] PATH_INFO: `/v3/projects/e99d4e2207734221a6aecea5ee729357` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.279331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99d4e2207734221a6aecea5ee729357)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:41.281518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:41.524056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99d4e2207734221a6aecea5ee729357', 'request_id': 'req-45959b6c-a610-468e-aa7d-d92120ca363d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:41.530413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99d4e2207734221a6aecea5ee729357', 'request_id': 'req-45959b6c-a610-468e-aa7d-d92120ca363d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:41.537594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99d4e2207734221a6aecea5ee729357', 'request_id': 'req-45959b6c-a610-468e-aa7d-d92120ca363d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:41.631202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] The token cache is being invalidate because project e99d4e2207734221a6aecea5ee729357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:41.631539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:41.632283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-45959b6c-a610-468e-aa7d-d92120ca363d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:41.638887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1232/2470] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:41 2022] DELETE /identity/v3/projects/e99d4e2207734221a6aecea5ee729357 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:41.641872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9747-521f-4977-b08b-0273ee65c5e8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.643439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9747-521f-4977-b08b-0273ee65c5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.643884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9747-521f-4977-b08b-0273ee65c5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.667899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e66c9747-521f-4977-b08b-0273ee65c5e8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:41.672101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e66c9747-521f-4977-b08b-0273ee65c5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:41.770114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1239/2471] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:41.770721 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd31ed-59df-48dc-acd3-7bf9ec03710e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.771043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd31ed-59df-48dc-acd3-7bf9ec03710e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.771293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd31ed-59df-48dc-acd3-7bf9ec03710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.797092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7fcd31ed-59df-48dc-acd3-7bf9ec03710e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:41.798427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7fcd31ed-59df-48dc-acd3-7bf9ec03710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:41.811182 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1233/2472] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:41.812756 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9747-521f-4977-b08b-0273ee65c5e8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:41.829624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9747-521f-4977-b08b-0273ee65c5e8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:41.839055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50617-199e-41ee-96c1-a97525c8ba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:41.839727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50617-199e-41ee-96c1-a97525c8ba89 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.840004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50617-199e-41ee-96c1-a97525c8ba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.840282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50617-199e-41ee-96c1-a97525c8ba89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.840969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50617-199e-41ee-96c1-a97525c8ba89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:41.841314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50617-199e-41ee-96c1-a97525c8ba89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:41.842985 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50617-199e-41ee-96c1-a97525c8ba89 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:41.863039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1240/2473] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:41.868039 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd31ed-59df-48dc-acd3-7bf9ec03710e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:41.880489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd31ed-59df-48dc-acd3-7bf9ec03710e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:41.886307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:41.886873 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.887243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.887463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.888289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:41.890330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:41.989944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba5a6-417b-40d9-81c0-d395ea6c12ac None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.990305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba5a6-417b-40d9-81c0-d395ea6c12ac None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.990693 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba5a6-417b-40d9-81c0-d395ea6c12ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.013325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6e9ba5a6-417b-40d9-81c0-d395ea6c12ac None None] MFA Rules not processed for user `5039be557cac46fa917a062148d01abf`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:42.014815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6e9ba5a6-417b-40d9-81c0-d395ea6c12ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:42.079298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1241/2474] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:42.504472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1234/2475] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:41 2022] POST /identity/v3/projects => generated 381 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:42.505710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ba5a6-417b-40d9-81c0-d395ea6c12ac None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:42.511457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:42.522159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ba5a6-417b-40d9-81c0-d395ea6c12ac None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:42.635556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:42.636198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:42.636474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:42.637692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.637984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:42.640088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:42.735128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1242/2476] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:42 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:42.740415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:42.783753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9cf43-c18f-4196-936d-5e5256d1489c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:42.793012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:42.794626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:42.795516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:42.795942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.802602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:42.804555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:42.833225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1235/2477] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:42.837372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:42.876625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77df5a-af89-4276-8bb8-ac05cccf35b7 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:42.891261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62b54e-dfd1-4cfd-8d49-2fd01375d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:42.892112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62b54e-dfd1-4cfd-8d49-2fd01375d22b admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:42.892397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62b54e-dfd1-4cfd-8d49-2fd01375d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:42.892822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62b54e-dfd1-4cfd-8d49-2fd01375d22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.896813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62b54e-dfd1-4cfd-8d49-2fd01375d22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:42.896813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62b54e-dfd1-4cfd-8d49-2fd01375d22b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:42.924565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1243/2478] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:42.925835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:42.940052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d23f0-fac9-4631-b0a5-db7db6251057 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:42.946476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:42.948248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:42.948921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:42.949764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] PATH_INFO: `/v3/projects/b141376640a84d609efe8aa2abf224dd/users/23475443a5a14c309f4493f4f0546d31/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.992274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b141376640a84d609efe8aa2abf224dd, user_id=23475443a5a14c309f4493f4f0546d31, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:43.002115 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:43.093162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1236/2479] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:42 2022] PUT /identity/v3/projects/b141376640a84d609efe8aa2abf224dd/users/23475443a5a14c309f4493f4f0546d31/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:43.101146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cda3-75dc-4056-ac41-b0825439a497 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:43.101431 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cda3-75dc-4056-ac41-b0825439a497 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:43.101727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cda3-75dc-4056-ac41-b0825439a497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:43.144227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-99a3cda3-75dc-4056-ac41-b0825439a497 None None] MFA Rules not processed for user `23475443a5a14c309f4493f4f0546d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:43.145495 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-99a3cda3-75dc-4056-ac41-b0825439a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:43.267583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1244/2480] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:43.268954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:43.369809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775eac-8aca-4f70-8025-9464bc5ad836 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:43.379897 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:43.380289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:43.380737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:43.381282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:43.382283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:43.384357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:43.390345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:43.518271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1237/2481] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:43 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:43.523177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cda3-75dc-4056-ac41-b0825439a497 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:43.538141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cda3-75dc-4056-ac41-b0825439a497 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:43.640918 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:43.641629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:43.642119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:43.642321 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:43.643098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:43.645519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:43.745905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:43.753179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1245/2482] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:43 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:43.757235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:43.768856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82fa42-32be-44ac-9152-55738282fd47 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:43.774215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:43.779411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:43.779411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:43.779411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:43.779411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:43.779411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:43.795992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1238/2483] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:43.797355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:43.809943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d84c-759f-4b13-9219-f40f8ff18bee admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:43.817049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:43.818048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:43.818547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:43.819355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] PATH_INFO: `/v3/projects/a0776deb6df148b181a15b53c2e8ebad/users/02d0b2f46094435e83cc9cdeac601e61/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:43.849969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0776deb6df148b181a15b53c2e8ebad, user_id=02d0b2f46094435e83cc9cdeac601e61, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:43.869385 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:44.048777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1246/2484] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:43 2022] PUT /identity/v3/projects/a0776deb6df148b181a15b53c2e8ebad/users/02d0b2f46094435e83cc9cdeac601e61/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:44.053366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:44.071964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a35b-7622-49f4-ab06-0f8b98bf4032 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:44.148985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b3229-ec9f-4657-bfda-5de5560029df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:44.150394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3229-ec9f-4657-bfda-5de5560029df admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:44.150870 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3229-ec9f-4657-bfda-5de5560029df admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:44.151239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3229-ec9f-4657-bfda-5de5560029df admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:44.152071 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b3229-ec9f-4657-bfda-5de5560029df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:44.154912 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b3229-ec9f-4657-bfda-5de5560029df admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:44.174994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1239/2485] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:44.179018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:44.196141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc55dec-56ba-4293-a9c8-971b8ebb39c0 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:44.203664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:44.204389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:44.207222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:44.207222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] PATH_INFO: `/v3/projects/a0776deb6df148b181a15b53c2e8ebad/users/02d0b2f46094435e83cc9cdeac601e61/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:44.207429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0776deb6df148b181a15b53c2e8ebad, user_id=02d0b2f46094435e83cc9cdeac601e61, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:44.210453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:44.234902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1247/2486] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:44 2022] PUT /identity/v3/projects/a0776deb6df148b181a15b53c2e8ebad/users/02d0b2f46094435e83cc9cdeac601e61/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:44.305734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4739d32-5e88-42f8-87c0-14dd8214f731 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:44.306079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4739d32-5e88-42f8-87c0-14dd8214f731 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:44.306463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4739d32-5e88-42f8-87c0-14dd8214f731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:44.338653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e4739d32-5e88-42f8-87c0-14dd8214f731 None None] MFA Rules not processed for user `02d0b2f46094435e83cc9cdeac601e61`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:44.339901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e4739d32-5e88-42f8-87c0-14dd8214f731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:44.415789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1240/2487] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:44.430560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:44.432247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:44.511790 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd51f-b163-49f7-8498-f3615ad702dd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:44.516417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc62b9e-d2e3-4906-b0df-af90c0d6dfe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:44.517091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62b9e-d2e3-4906-b0df-af90c0d6dfe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:44.517366 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62b9e-d2e3-4906-b0df-af90c0d6dfe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:44.517794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62b9e-d2e3-4906-b0df-af90c0d6dfe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:44.529530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc62b9e-d2e3-4906-b0df-af90c0d6dfe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:44.531040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc62b9e-d2e3-4906-b0df-af90c0d6dfe2 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:44.543704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1248/2488] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:45.283613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4739d32-5e88-42f8-87c0-14dd8214f731 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:45.381780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:45.393617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4739d32-5e88-42f8-87c0-14dd8214f731 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:45.403269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:45.404075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:45.404787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:45.405467 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] PATH_INFO: `/v3/users/23475443a5a14c309f4493f4f0546d31` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:45.408544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23475443a5a14c309f4493f4f0546d31)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:45.412343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:45.743540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23475443a5a14c309f4493f4f0546d31'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:45.760102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23475443a5a14c309f4493f4f0546d31'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:45.769323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23475443a5a14c309f4493f4f0546d31'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:45.893915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23475443a5a14c309f4493f4f0546d31'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:45.894486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23475443a5a14c309f4493f4f0546d31'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:45.909162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1241/2489] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:45 2022] DELETE /identity/v3/users/23475443a5a14c309f4493f4f0546d31 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:45.914370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:45.914973 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:45.916311 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:45.957193 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:45.958980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:46.040418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1249/2490] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:46.062146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:46.075415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:46.134847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c5d55-942f-4c58-8bef-69e6c377a820 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:46.142556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:46.145084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:46.146273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:46.146273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:46.157934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:46.159609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:46.171539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1242/2491] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:46.439533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:46.441948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:46.455509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738645-7db9-420f-b0df-47f98e326af1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:46.460436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:46.461093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:46.461394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:46.461665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] PATH_INFO: `/v3/users/1456c4aeb4b64ec5b81ab2c6df2abbb2` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:46.462819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1456c4aeb4b64ec5b81ab2c6df2abbb2)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:46.464761 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:46.681441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1456c4aeb4b64ec5b81ab2c6df2abbb2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:46.692784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:46.695453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1456c4aeb4b64ec5b81ab2c6df2abbb2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:46.696419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1456c4aeb4b64ec5b81ab2c6df2abbb2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:46.711624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1456c4aeb4b64ec5b81ab2c6df2abbb2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:46.759859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:46.761574 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:46.779129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8725-f252-445a-9992-3ae838903ece service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:46.780823 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1456c4aeb4b64ec5b81ab2c6df2abbb2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:46.786069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:46.786931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:46.787252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:46.787645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] PATH_INFO: `/v3/projects/b141376640a84d609efe8aa2abf224dd` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:46.789036 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b141376640a84d609efe8aa2abf224dd)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:46.791505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:46.794502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1250/2492] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:46 2022] DELETE /identity/v3/users/1456c4aeb4b64ec5b81ab2c6df2abbb2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:46.926827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b141376640a84d609efe8aa2abf224dd', 'request_id': 'req-b672436e-531c-4040-a600-f66fb1603cf9'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:46.933648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b141376640a84d609efe8aa2abf224dd', 'request_id': 'req-b672436e-531c-4040-a600-f66fb1603cf9'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:46.941502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b141376640a84d609efe8aa2abf224dd', 'request_id': 'req-b672436e-531c-4040-a600-f66fb1603cf9'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.006906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:47.010784 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] The token cache is being invalidate because project b141376640a84d609efe8aa2abf224dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:47.011074 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.011719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.018292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1243/2493] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:46 2022] DELETE /identity/v3/projects/b141376640a84d609efe8aa2abf224dd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:47.018454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:47.019645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:47.093111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c912d-5864-4227-a189-5c3065bb9ff3 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:47.104643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:47.106941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:47.178745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:47.179436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.179748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.180023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] PATH_INFO: `/v3/users/02d0b2f46094435e83cc9cdeac601e61` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.181356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d0b2f46094435e83cc9cdeac601e61)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:47.183377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:47.210797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672436e-531c-4040-a600-f66fb1603cf9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:47.216331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:47.216992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.217300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.217576 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] PATH_INFO: `/v3/projects/cd844ffb302343af8d3e33271d1dc3fd` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.218818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd844ffb302343af8d3e33271d1dc3fd)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:47.220798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:47.416257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d0b2f46094435e83cc9cdeac601e61'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.417813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd844ffb302343af8d3e33271d1dc3fd', 'request_id': 'req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.425785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd844ffb302343af8d3e33271d1dc3fd', 'request_id': 'req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.433775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd844ffb302343af8d3e33271d1dc3fd', 'request_id': 'req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.439251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d0b2f46094435e83cc9cdeac601e61'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.440248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d0b2f46094435e83cc9cdeac601e61'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.458261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d0b2f46094435e83cc9cdeac601e61'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.516019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] The token cache is being invalidate because project cd844ffb302343af8d3e33271d1dc3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:47.516421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.517042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-24dd1923-197c-4ab5-a58d-d1282ee0b4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.519129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1244/2494] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:47 2022] DELETE /identity/v3/projects/cd844ffb302343af8d3e33271d1dc3fd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:47.523820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0521-5710-453a-917a-47d7b822fd8a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.524104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0521-5710-453a-917a-47d7b822fd8a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.524385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0521-5710-453a-917a-47d7b822fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.546727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-7dce0521-5710-453a-917a-47d7b822fd8a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:47.547983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7dce0521-5710-453a-917a-47d7b822fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:47.595654 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4de55e1b-d6a8-478a-b459-0427123b3706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d0b2f46094435e83cc9cdeac601e61'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:47.606813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1251/2495] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:47 2022] DELETE /identity/v3/users/02d0b2f46094435e83cc9cdeac601e61 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:47.637773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1245/2496] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:47.645590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd7b7-7789-4223-b99b-c79e7c191674 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.646556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd7b7-7789-4223-b99b-c79e7c191674 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.646556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd7b7-7789-4223-b99b-c79e7c191674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.659087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:47.671233 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f53cd7b7-7789-4223-b99b-c79e7c191674 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:47.672482 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f53cd7b7-7789-4223-b99b-c79e7c191674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:47.739395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1252/2497] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:47.743770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0521-5710-453a-917a-47d7b822fd8a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:47.754525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0521-5710-453a-917a-47d7b822fd8a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:47.759433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:47.760043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.761013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.761013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.767172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:47.767172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:47.767172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:47.780465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1246/2498] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:47.782056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd7b7-7789-4223-b99b-c79e7c191674 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:47.791938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd7b7-7789-4223-b99b-c79e7c191674 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:47.797074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:47.797726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.798014 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.798432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.799085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:47.801039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:47.954695 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1253/2499] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:47 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:47.957324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:47.972886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9805-70bd-49e8-933a-ff1e815f8027 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:47.995055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:48.048877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.049534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.049818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.050142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.050776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.052706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.133885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1247/2500] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:47 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:48.138410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.151055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185784aa-7ed5-4b03-b72e-ffb4e9a71567 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.155961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.156121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.156704 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.156999 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.157337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.158003 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.158622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:48.159619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.171481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1254/2501] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:48.175412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.175850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1beeaa-0e5d-43bc-851a-c14f2de5b55c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.181524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.182988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.183322 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.183634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] PATH_INFO: `/v3/projects/a0776deb6df148b181a15b53c2e8ebad` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.185783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0776deb6df148b181a15b53c2e8ebad)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.186831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaba7c-224f-47c6-bc21-aaa944a7d7fa admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.188046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.194177 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.195201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.195679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.196196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.197041 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.199746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.216604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1255/2502] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:48.217562 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.228497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd9e7-099d-4e0a-94e2-9c374718e15a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.236567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135b2b-8ee4-4df6-b67d-ce1eb1a61944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.237463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135b2b-8ee4-4df6-b67d-ce1eb1a61944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.237747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135b2b-8ee4-4df6-b67d-ce1eb1a61944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.238534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135b2b-8ee4-4df6-b67d-ce1eb1a61944 admin admin] PATH_INFO: `/v3/projects/2bfedf19f70e483799f6b54ebb965b9a/users/a850a2fde00a48c888d62b136a479d2f/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.256853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135b2b-8ee4-4df6-b67d-ce1eb1a61944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfedf19f70e483799f6b54ebb965b9a, user_id=a850a2fde00a48c888d62b136a479d2f, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.260778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135b2b-8ee4-4df6-b67d-ce1eb1a61944 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.394692 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1256/2503] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:48 2022] PUT /identity/v3/projects/2bfedf19f70e483799f6b54ebb965b9a/users/a850a2fde00a48c888d62b136a479d2f/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:48.405492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8c29-4e44-4483-8dab-fd253b628794 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.405781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8c29-4e44-4483-8dab-fd253b628794 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.406053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8c29-4e44-4483-8dab-fd253b628794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.406517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0776deb6df148b181a15b53c2e8ebad', 'request_id': 'req-6d5dc62f-0218-4291-a2a5-23e58ac84536'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:48.414531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0776deb6df148b181a15b53c2e8ebad', 'request_id': 'req-6d5dc62f-0218-4291-a2a5-23e58ac84536'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:48.423095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0776deb6df148b181a15b53c2e8ebad', 'request_id': 'req-6d5dc62f-0218-4291-a2a5-23e58ac84536'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:48.436412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2a0d8c29-4e44-4483-8dab-fd253b628794 None None] MFA Rules not processed for user `a850a2fde00a48c888d62b136a479d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:48.437652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2a0d8c29-4e44-4483-8dab-fd253b628794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:48.506001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] The token cache is being invalidate because project a0776deb6df148b181a15b53c2e8ebad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:48.506283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:48.507289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:48.510108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1257/2504] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:48.510259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1248/2505] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:48 2022] DELETE /identity/v3/projects/a0776deb6df148b181a15b53c2e8ebad => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:48.514627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea7db0-fe32-4f59-b44d-98c82d1399f5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.515393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea7db0-fe32-4f59-b44d-98c82d1399f5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.515663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea7db0-fe32-4f59-b44d-98c82d1399f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.516312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.517775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:48.537498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-07ea7db0-fe32-4f59-b44d-98c82d1399f5 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:48.538717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-07ea7db0-fe32-4f59-b44d-98c82d1399f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:48.582235 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:48.594563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc62f-0218-4291-a2a5-23e58ac84536 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.599701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.600575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.600934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.601566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.602255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.604476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.612817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1258/2506] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:48.620567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dc18b-0203-4c53-9935-860598e1a261 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.620957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dc18b-0203-4c53-9935-860598e1a261 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.621175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dc18b-0203-4c53-9935-860598e1a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.642747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f94dc18b-0203-4c53-9935-860598e1a261 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:48.643935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f94dc18b-0203-4c53-9935-860598e1a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:48.652315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1259/2507] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:48.656715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dc18b-0203-4c53-9935-860598e1a261 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.666224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dc18b-0203-4c53-9935-860598e1a261 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.675215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.675845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.676768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.676768 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.677325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:48.677634 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.679239 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.693660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1260/2508] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:48.698375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.709840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a60dc-9482-47be-b15c-57d6116ec3a1 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.715578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.716510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.716793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.717083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.717841 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.720045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.790185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1249/2509] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:48 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:48.794031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.879316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2adb-1815-49ac-9ba8-762956cfc10e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:48.887533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:48.887533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:48.887533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:48.887533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:48.888191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:48.889130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:48.930941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1261/2510] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:48 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:48.934895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:48.996884 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1250/2511] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:48 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:49.001187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.011150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91feda4-8139-4309-b6e3-86dc24a84be4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.039680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3b8fc-4420-4ac1-8e73-85e8cfaee5fa admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.045558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.046186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.046890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.046890 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.047407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.049550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.077403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.078013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.078347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.078627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.079264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.080892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.090752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1251/2512] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:49.095111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.105306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba38302-273f-4923-9883-1da1dddd7725 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.110159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.110788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.111088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.111341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] PATH_INFO: `/v3/projects/7762496d2c1d4a919de429742455755f/users/727d30526db74534961fd8b500d8729f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.127138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7762496d2c1d4a919de429742455755f, user_id=727d30526db74534961fd8b500d8729f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.130944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.162120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1262/2513] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:48 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:49.166211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.176915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fa624-5a70-47d7-ab65-29136817a8f5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.182512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.183212 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.184077 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.184416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.185187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.186923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.197415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1263/2514] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:49.201998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.212131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c30af-d71e-4d8a-a791-cdcd99f4d286 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.216730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:49.218406 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.219036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.219323 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.219697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.220259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.222019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.233836 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1264/2515] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:49.238517 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.249932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c90c-577d-429f-9a78-09e228c1777d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.257445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1252/2516] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:49 2022] PUT /identity/v3/projects/7762496d2c1d4a919de429742455755f/users/727d30526db74534961fd8b500d8729f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:49.261340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.327900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef815-fabb-4590-b6ee-b440f6cef5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.328405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef815-fabb-4590-b6ee-b440f6cef5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.328772 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef815-fabb-4590-b6ee-b440f6cef5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.329288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef815-fabb-4590-b6ee-b440f6cef5c0 admin admin] PATH_INFO: `/v3/projects/4d9c054ae00a422d811b56e8328a1d3e/users/8e3a08fef51b4cb3a3359b827e069d0f/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.357945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef815-fabb-4590-b6ee-b440f6cef5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9c054ae00a422d811b56e8328a1d3e, user_id=8e3a08fef51b4cb3a3359b827e069d0f, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.361173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef815-fabb-4590-b6ee-b440f6cef5c0 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.398758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154206-beb3-46f0-96d3-e44bbcc7db61 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.402978 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.403625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.403904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.404171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.404813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.406653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.416799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1253/2517] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:37:49.421527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.431781 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6076323-9b68-4fd0-8198-b66c55ddf100 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.436885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf26450-794a-4bce-9488-83cdfee8f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.437908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf26450-794a-4bce-9488-83cdfee8f0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.438318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf26450-794a-4bce-9488-83cdfee8f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.438597 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf26450-794a-4bce-9488-83cdfee8f0b7 admin admin] PATH_INFO: `/v3/projects/7762496d2c1d4a919de429742455755f/users/727d30526db74534961fd8b500d8729f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.440588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf26450-794a-4bce-9488-83cdfee8f0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7762496d2c1d4a919de429742455755f, user_id=727d30526db74534961fd8b500d8729f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.443341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf26450-794a-4bce-9488-83cdfee8f0b7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.457114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1254/2518] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:49 2022] PUT /identity/v3/projects/7762496d2c1d4a919de429742455755f/users/727d30526db74534961fd8b500d8729f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:49.472522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.472874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.472995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1265/2519] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:49 2022] PUT /identity/v3/projects/4d9c054ae00a422d811b56e8328a1d3e/users/8e3a08fef51b4cb3a3359b827e069d0f/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:37:49.473208 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.484967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.484967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.485160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.505734 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:49.509320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] MFA Rules not processed for user `727d30526db74534961fd8b500d8729f`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:49.510653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:49.555044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] MFA Rules not processed for user `8e3a08fef51b4cb3a3359b827e069d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:49.556393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:49.618049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1255/2520] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:49.634526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.637630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:49.656207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1266/2521] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:49.665708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:49.667183 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:49.713274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a058c-71d7-42db-ae99-1bfd2d983d00 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.718284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.719832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.719832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.719832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.732160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.733829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.745371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1256/2522] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:49.763434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aada64-895b-49f7-a475-168a4742e1a9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:49.769016 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93cef-0a28-4a7c-a427-d6228b67db6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:49.769409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cef-0a28-4a7c-a427-d6228b67db6b service glance] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.769690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cef-0a28-4a7c-a427-d6228b67db6b service glance] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.769965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cef-0a28-4a7c-a427-d6228b67db6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.780597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93cef-0a28-4a7c-a427-d6228b67db6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:49.782179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93cef-0a28-4a7c-a427-d6228b67db6b service glance] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:49.792144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1267/2523] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:50.906188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:51.343540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:51.415755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743c42-e927-4009-841e-5fce03d9182b service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:51.424264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:51.424264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:51.424743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:51.424929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] PATH_INFO: `/v3/users/a850a2fde00a48c888d62b136a479d2f` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:51.426127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a850a2fde00a48c888d62b136a479d2f)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:51.428107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:51.831164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a850a2fde00a48c888d62b136a479d2f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:51.847377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a850a2fde00a48c888d62b136a479d2f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:51.856245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a850a2fde00a48c888d62b136a479d2f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:51.944941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a850a2fde00a48c888d62b136a479d2f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:51.945771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a850a2fde00a48c888d62b136a479d2f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:51.953623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1257/2524] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:51 2022] DELETE /identity/v3/users/a850a2fde00a48c888d62b136a479d2f => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:51.958820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:51.959349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:51.959475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:51.983769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:51.985162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:52.070669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1268/2525] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:52.082346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:52.083785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:52.161654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53f912-65c3-46d6-ad9a-9bcf0dc21742 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:52.165810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:52.166539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:52.166816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:52.167087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:52.177666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:52.179157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:52.190272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1258/2526] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:52.196280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:52.839198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:52.840857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:52.856030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab9c85-6644-432c-8087-361a2a94ec06 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:52.861248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:52.861952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:52.862351 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:52.862496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] PATH_INFO: `/v3/projects/2bfedf19f70e483799f6b54ebb965b9a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:52.863637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bfedf19f70e483799f6b54ebb965b9a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:52.866057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:52.871401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:53.022201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bfedf19f70e483799f6b54ebb965b9a', 'request_id': 'req-9883df64-b634-457d-b722-d27873d9bae9'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:53.110112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bfedf19f70e483799f6b54ebb965b9a', 'request_id': 'req-9883df64-b634-457d-b722-d27873d9bae9'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:53.116553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bfedf19f70e483799f6b54ebb965b9a', 'request_id': 'req-9883df64-b634-457d-b722-d27873d9bae9'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:53.133074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] The token cache is being invalidate because project 2bfedf19f70e483799f6b54ebb965b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:53.133690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:53.134405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:53.136159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1269/2527] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:52 2022] DELETE /identity/v3/projects/2bfedf19f70e483799f6b54ebb965b9a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:53.140440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:53.154092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ed2d-b32e-450a-a552-9ca18cefd82c service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:53.242385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:53.243352 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:53.243634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:53.243950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] PATH_INFO: `/v3/users/727d30526db74534961fd8b500d8729f` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:53.246456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=727d30526db74534961fd8b500d8729f)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:53.247757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:53.875869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727d30526db74534961fd8b500d8729f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:53.882828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:53.897035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727d30526db74534961fd8b500d8729f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:53.906242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727d30526db74534961fd8b500d8729f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:54.030167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727d30526db74534961fd8b500d8729f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:54.031304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-37dbc4e1-ba5c-4147-b1ca-9c3d835f8c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727d30526db74534961fd8b500d8729f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:54.037789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1259/2528] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:53 2022] DELETE /identity/v3/users/727d30526db74534961fd8b500d8729f => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:54.773794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:54.776575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:54.793826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883df64-b634-457d-b722-d27873d9bae9 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:54.867086 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:54.868204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:54.868736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:54.869281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] PATH_INFO: `/v3/projects/7762496d2c1d4a919de429742455755f` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:54.870820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7762496d2c1d4a919de429742455755f)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:54.872860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:55.017940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7762496d2c1d4a919de429742455755f', 'request_id': 'req-f319a3e6-eea3-4ea5-9117-22dd82c6a155'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:55.173128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7762496d2c1d4a919de429742455755f', 'request_id': 'req-f319a3e6-eea3-4ea5-9117-22dd82c6a155'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:55.179918 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7762496d2c1d4a919de429742455755f', 'request_id': 'req-f319a3e6-eea3-4ea5-9117-22dd82c6a155'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:55.195090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] The token cache is being invalidate because project 7762496d2c1d4a919de429742455755f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:55.195447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:55.196215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f319a3e6-eea3-4ea5-9117-22dd82c6a155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:55.197881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1270/2529] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:54 2022] DELETE /identity/v3/projects/7762496d2c1d4a919de429742455755f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:55.203787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2423-7579-4819-9385-24467655f18a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:55.204337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2423-7579-4819-9385-24467655f18a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:55.204475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2423-7579-4819-9385-24467655f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:55.230823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-063d2423-7579-4819-9385-24467655f18a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:55.232161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-063d2423-7579-4819-9385-24467655f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:55.335168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1260/2530] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:55.343663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef38d-1c10-4e9a-84c2-5a9532f5df95 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:55.354220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef38d-1c10-4e9a-84c2-5a9532f5df95 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:55.354220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef38d-1c10-4e9a-84c2-5a9532f5df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:55.368886 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-581ef38d-1c10-4e9a-84c2-5a9532f5df95 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:55.370397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-581ef38d-1c10-4e9a-84c2-5a9532f5df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:55.380145 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1271/2531] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:55.384898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2423-7579-4819-9385-24467655f18a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:55.396297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2423-7579-4819-9385-24467655f18a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:55.428724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:55.428724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:55.428724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:55.428724 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:55.429286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:37:55.429286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:55.429286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:55.429286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1261/2532] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:55.432100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef38d-1c10-4e9a-84c2-5a9532f5df95 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:55.443055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef38d-1c10-4e9a-84c2-5a9532f5df95 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:55.449363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:55.450001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:55.450285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:55.451473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:55.451473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:55.453498 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:55.471539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:55.642946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1272/2533] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:55.644501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:55.664574 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d877f-e2c5-428f-a539-dccb6e64ef8c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:55.757374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:55.758025 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:55.758308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:55.758585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:55.759240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:55.761248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:55.998282 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1262/2534] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:55 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:56.001942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:56.013363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e64e7-d87f-4277-967a-262bb013f34d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:56.020153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaac25-9353-4607-b1a7-4b3bc21cddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:56.020782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaac25-9353-4607-b1a7-4b3bc21cddfd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.021249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaac25-9353-4607-b1a7-4b3bc21cddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.021556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaac25-9353-4607-b1a7-4b3bc21cddfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.022529 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaac25-9353-4607-b1a7-4b3bc21cddfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:56.024135 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaac25-9353-4607-b1a7-4b3bc21cddfd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:56.040112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1273/2535] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:56.041371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:56.052908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b93fd-3d33-441e-ae79-a982a529c3a2 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:56.116880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:56.116880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.116880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.116880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.118217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:56.118217 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:56.118591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.118591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.118591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.118866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1263/2536] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:56.118958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:56.118958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:56.120341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:56.133761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691e93-9672-449c-94f3-2c9f4102be82 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:56.139995 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:56.140762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.141183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.141523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] PATH_INFO: `/v3/projects/1bdfbe6e2aa9452098bba2110b9ceaf8/users/2dbc520b6bd2404bb76bde7d1dfe96b5/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.163433 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdfbe6e2aa9452098bba2110b9ceaf8, user_id=2dbc520b6bd2404bb76bde7d1dfe96b5, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:56.170087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:56.176861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1274/2537] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:56.191558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:56.193189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:56.271447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d602b07-15b5-421a-80c5-317aa00c2fa9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:56.282034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4562-e76e-4f5f-9ff5-8cd7b5740ec4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:56.282668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4562-e76e-4f5f-9ff5-8cd7b5740ec4 service swift] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.282948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4562-e76e-4f5f-9ff5-8cd7b5740ec4 service swift] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.283487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4562-e76e-4f5f-9ff5-8cd7b5740ec4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.296001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4562-e76e-4f5f-9ff5-8cd7b5740ec4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:56.298091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4562-e76e-4f5f-9ff5-8cd7b5740ec4 service swift] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:56.309427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1275/2538] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:37:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:37:56.367164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1264/2539] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:56 2022] PUT /identity/v3/projects/1bdfbe6e2aa9452098bba2110b9ceaf8/users/2dbc520b6bd2404bb76bde7d1dfe96b5/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:56.378950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a5fa3-ae0b-483e-b00f-19c0524ac5c9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.379241 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a5fa3-ae0b-483e-b00f-19c0524ac5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.379521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a5fa3-ae0b-483e-b00f-19c0524ac5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.536432 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-839a5fa3-ae0b-483e-b00f-19c0524ac5c9 None None] MFA Rules not processed for user `2dbc520b6bd2404bb76bde7d1dfe96b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:56.538486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-839a5fa3-ae0b-483e-b00f-19c0524ac5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:56.649246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1276/2540] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:56.655314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:56.669863 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:56.734119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930d8d-177a-46bc-95bd-aff6952433c9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:56.738763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:56.739508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.739836 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.740118 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.740837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:56.743021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:56.882007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a5fa3-ae0b-483e-b00f-19c0524ac5c9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:56.890495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1265/2541] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:37:56 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:37:56.900421 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a5fa3-ae0b-483e-b00f-19c0524ac5c9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:57.038020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:57.038837 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:57.039197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:57.039476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:57.041203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:57.044573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:57.049740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:57.207309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1277/2542] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:37:56 2022] POST /identity/v3/users => generated 299 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:37:57.216501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:57.228760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c09-3a1f-44b8-a374-1a9ff28e5193 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:57.237997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:57.240220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:57.241676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:57.242247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:57.243498 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:57.247010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:57.271018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1266/2543] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:57.275399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:57.295596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad22cba-d7a3-4c88-9cc8-a888bae25db1 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:57.308750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:57.309600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:57.309943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:57.310599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] PATH_INFO: `/v3/projects/cfe613c594244ab98fd2182658e42b5a/users/825543df143d4aadb87a0f0533ba1613/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:57.346282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe613c594244ab98fd2182658e42b5a, user_id=825543df143d4aadb87a0f0533ba1613, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:57.352698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:57.526282 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1278/2544] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:57 2022] PUT /identity/v3/projects/cfe613c594244ab98fd2182658e42b5a/users/825543df143d4aadb87a0f0533ba1613/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:57.530560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:57.634161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5f04-7ea6-4d2f-94c9-ce9da5b93392 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:57.721683 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f2c5-d59f-4820-8eea-e3379b378321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:57.722676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f2c5-d59f-4820-8eea-e3379b378321 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:57.722676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f2c5-d59f-4820-8eea-e3379b378321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:57.722975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f2c5-d59f-4820-8eea-e3379b378321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:57.724373 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f2c5-d59f-4820-8eea-e3379b378321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:57.725349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f2c5-d59f-4820-8eea-e3379b378321 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:57.745560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1267/2545] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:37:57.752206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:57.824962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a227c2-8d8e-407e-a4ba-521364277e7c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:57.831085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:57.833286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:57.833286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:57.833286 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] PATH_INFO: `/v3/projects/cfe613c594244ab98fd2182658e42b5a/users/825543df143d4aadb87a0f0533ba1613/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:57.835465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe613c594244ab98fd2182658e42b5a, user_id=825543df143d4aadb87a0f0533ba1613, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:57.838596 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:57.852478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1279/2546] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:37:57 2022] PUT /identity/v3/projects/cfe613c594244ab98fd2182658e42b5a/users/825543df143d4aadb87a0f0533ba1613/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:57.866743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296b14e-a97c-414f-8f50-0926c32a9149 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:57.867255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296b14e-a97c-414f-8f50-0926c32a9149 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:57.867754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296b14e-a97c-414f-8f50-0926c32a9149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:57.932000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3296b14e-a97c-414f-8f50-0926c32a9149 None None] MFA Rules not processed for user `825543df143d4aadb87a0f0533ba1613`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:57.933649 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3296b14e-a97c-414f-8f50-0926c32a9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:57.967534 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:58.033176 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1268/2547] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:58.048113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:58.049958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:58.161865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9c06-71fd-4256-a154-df6096e58a95 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:58.166101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76aa302-e838-4365-b62d-75a79955ca9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:58.166715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aa302-e838-4365-b62d-75a79955ca9b service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:58.166996 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aa302-e838-4365-b62d-75a79955ca9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:58.167263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aa302-e838-4365-b62d-75a79955ca9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:58.177508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76aa302-e838-4365-b62d-75a79955ca9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:58.179481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76aa302-e838-4365-b62d-75a79955ca9b service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:58.192110 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1280/2548] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:58.226643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296b14e-a97c-414f-8f50-0926c32a9149 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:58.356237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296b14e-a97c-414f-8f50-0926c32a9149 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:58.367480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:58.369276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:58.369276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:58.369276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] PATH_INFO: `/v3/users/2dbc520b6bd2404bb76bde7d1dfe96b5` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:58.371072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dbc520b6bd2404bb76bde7d1dfe96b5)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:58.373203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:58.648706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dbc520b6bd2404bb76bde7d1dfe96b5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:58.663448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dbc520b6bd2404bb76bde7d1dfe96b5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:58.673530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dbc520b6bd2404bb76bde7d1dfe96b5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:58.767021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dbc520b6bd2404bb76bde7d1dfe96b5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:58.768246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dbc520b6bd2404bb76bde7d1dfe96b5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:58.784407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1269/2549] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:58 2022] DELETE /identity/v3/users/2dbc520b6bd2404bb76bde7d1dfe96b5 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:58.787162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:58.787625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:58.788045 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:58.797111 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:58.875315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:58.876456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:58.951249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1281/2550] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:58.961494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:58.962988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:59.012403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:59.032678 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79b8b7-52b9-475f-92bb-622dec9470c6 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:59.036700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:59.037252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:59.037774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:59.037774 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:59.048339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:59.050144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:59.065488 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1270/2551] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:59.592859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:59.596104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:59.634152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f37f0-c289-4321-8462-8bc4a7725f32 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:59.645550 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:59.647422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:59.647804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:59.648180 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] PATH_INFO: `/v3/projects/1bdfbe6e2aa9452098bba2110b9ceaf8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:59.650508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdfbe6e2aa9452098bba2110b9ceaf8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:59.653224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:59.795852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdfbe6e2aa9452098bba2110b9ceaf8', 'request_id': 'req-54079345-2083-4771-a0a5-4fd33ead4ec1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:59.871191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdfbe6e2aa9452098bba2110b9ceaf8', 'request_id': 'req-54079345-2083-4771-a0a5-4fd33ead4ec1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:59.882812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdfbe6e2aa9452098bba2110b9ceaf8', 'request_id': 'req-54079345-2083-4771-a0a5-4fd33ead4ec1'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:59.905081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] The token cache is being invalidate because project 1bdfbe6e2aa9452098bba2110b9ceaf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:37:59.905410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:59.906112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:37:59.907820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1282/2552] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:37:59 2022] DELETE /identity/v3/projects/1bdfbe6e2aa9452098bba2110b9ceaf8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:37:59.912233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:59.932308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db71b2-081c-4d41-b517-18c1099d68a4 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:00.038506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:00.039229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:00.039468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:00.039749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] PATH_INFO: `/v3/users/825543df143d4aadb87a0f0533ba1613` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:00.041988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825543df143d4aadb87a0f0533ba1613)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:00.044088 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:00.245024 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825543df143d4aadb87a0f0533ba1613'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:00.263840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825543df143d4aadb87a0f0533ba1613'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:00.278428 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825543df143d4aadb87a0f0533ba1613'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:00.401652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825543df143d4aadb87a0f0533ba1613'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:00.402543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3221c850-b2fa-4f1f-bd50-e1d8c2d956f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825543df143d4aadb87a0f0533ba1613'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:00.410799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1271/2553] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:37:59 2022] DELETE /identity/v3/users/825543df143d4aadb87a0f0533ba1613 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:00.942946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:00.944978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:00.978398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54079345-2083-4771-a0a5-4fd33ead4ec1 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:01.091867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:01.092534 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:01.093013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:01.093380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] PATH_INFO: `/v3/projects/cfe613c594244ab98fd2182658e42b5a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:01.094588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe613c594244ab98fd2182658e42b5a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:01.096747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:01.123019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:01.386245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe613c594244ab98fd2182658e42b5a', 'request_id': 'req-201f78d9-097b-43fa-9f13-64296e182e5d'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:01.670445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe613c594244ab98fd2182658e42b5a', 'request_id': 'req-201f78d9-097b-43fa-9f13-64296e182e5d'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:01.686264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe613c594244ab98fd2182658e42b5a', 'request_id': 'req-201f78d9-097b-43fa-9f13-64296e182e5d'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:01.703646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] The token cache is being invalidate because project cfe613c594244ab98fd2182658e42b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:01.703951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:01.704894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-201f78d9-097b-43fa-9f13-64296e182e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:01.708152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1283/2554] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:00 2022] DELETE /identity/v3/projects/cfe613c594244ab98fd2182658e42b5a => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:01.715069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5c279-ffd9-49d6-bc92-3ae036d77f80 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:01.719481 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5c279-ffd9-49d6-bc92-3ae036d77f80 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:01.719481 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5c279-ffd9-49d6-bc92-3ae036d77f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:01.806703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-86d5c279-ffd9-49d6-bc92-3ae036d77f80 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:01.807981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-86d5c279-ffd9-49d6-bc92-3ae036d77f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:01.854358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:01.898887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1272/2555] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:01.911194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899278f-c520-4ac0-9cec-d22ba1081f63 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:01.911698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899278f-c520-4ac0-9cec-d22ba1081f63 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:01.912184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899278f-c520-4ac0-9cec-d22ba1081f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:01.966434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0899278f-c520-4ac0-9cec-d22ba1081f63 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:01.969802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0899278f-c520-4ac0-9cec-d22ba1081f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:01.977983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1284/2556] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:01.982790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5c279-ffd9-49d6-bc92-3ae036d77f80 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:01.997407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5c279-ffd9-49d6-bc92-3ae036d77f80 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:02.005444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:02.006315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.006702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.007140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.007932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:38:02.008351 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:02.010577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:02.033219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1273/2557] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:38:02.043731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899278f-c520-4ac0-9cec-d22ba1081f63 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:02.058752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899278f-c520-4ac0-9cec-d22ba1081f63 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:02.063913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:02.072144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.072590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.072875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.074702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:02.088040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:02.221866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1285/2558] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:02 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:02.226598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:02.239842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c536727-f6e1-4178-bf35-2b075df62a65 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:02.336058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:02.337259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.337755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.338214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.339112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:02.342882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:02.445945 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1274/2559] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:02 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:02.450417 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:02.470759 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1c1f-f279-45b9-81da-aa7719e4ec45 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:02.482400 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:02.486736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.486736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.486736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.486736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:02.486736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:02.498335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1286/2560] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:02.502394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:02.519362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495cf32-26ec-4423-be2c-4fba1579ecee admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:02.524963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6fb4e-d857-410d-8302-c7e5f5e04957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:02.526001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6fb4e-d857-410d-8302-c7e5f5e04957 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.527342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6fb4e-d857-410d-8302-c7e5f5e04957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.527840 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6fb4e-d857-410d-8302-c7e5f5e04957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.528967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6fb4e-d857-410d-8302-c7e5f5e04957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:02.530944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6fb4e-d857-410d-8302-c7e5f5e04957 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:02.548834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1275/2561] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:02.550303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:02.564545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78412c6b-0e73-443e-b846-d22cccbf3613 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:02.575925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:02.576781 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.577370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.578075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] PATH_INFO: `/v3/projects/e339cd17850443efaa692bd49e223a55/users/4da26c5237034d4eaf557e652b55c644/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.595995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e339cd17850443efaa692bd49e223a55, user_id=4da26c5237034d4eaf557e652b55c644, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:02.599414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:02.728211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1287/2562] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:02 2022] PUT /identity/v3/projects/e339cd17850443efaa692bd49e223a55/users/4da26c5237034d4eaf557e652b55c644/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:02.740855 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ec30-250e-44ed-9a23-2fd33b690977 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.741517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ec30-250e-44ed-9a23-2fd33b690977 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.741517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ec30-250e-44ed-9a23-2fd33b690977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.793696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a1b5ec30-250e-44ed-9a23-2fd33b690977 None None] MFA Rules not processed for user `4da26c5237034d4eaf557e652b55c644`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:02.795131 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a1b5ec30-250e-44ed-9a23-2fd33b690977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:02.894943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1276/2563] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:02.896379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:02.986258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15de8a-1e76-457c-a8fb-dadbee63e5c3 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:02.991609 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:02.992224 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:02.992503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:02.992775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:02.993894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:02.995586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:03.092502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1288/2564] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:02 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:03.097169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ec30-250e-44ed-9a23-2fd33b690977 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:03.120273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ec30-250e-44ed-9a23-2fd33b690977 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:03.165317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:03.205336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:03.206434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:03.206869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:03.207306 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:03.208190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:03.210385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:03.328525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1277/2565] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:03 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:03.334285 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:03.348473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2da5e-6c11-4742-a82b-ba41d1d3e829 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:03.353655 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:03.354450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:03.355604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:03.355986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:03.356789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:03.358976 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:03.403861 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:03.420820 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1289/2566] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:03.431389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e470-b021-4ccf-af93-82e8727805ec admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:03.438536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:03.439288 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:03.439594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:03.439856 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] PATH_INFO: `/v3/projects/9100a9e4a1604661870c3bbc2433782c/users/6a8e0a0c3a72440188776f80493d4cfa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:03.459991 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9100a9e4a1604661870c3bbc2433782c, user_id=6a8e0a0c3a72440188776f80493d4cfa, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:03.463271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:03.547484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1278/2567] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:03 2022] PUT /identity/v3/projects/9100a9e4a1604661870c3bbc2433782c/users/6a8e0a0c3a72440188776f80493d4cfa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:03.549138 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:03.560934 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76cff7-b87b-4aac-9538-3dc5143d8c6e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:03.590471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:03.676965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ba935-6af0-4a54-863d-9e99c92acb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:03.679027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ba935-6af0-4a54-863d-9e99c92acb39 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:03.679905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ba935-6af0-4a54-863d-9e99c92acb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:03.680746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ba935-6af0-4a54-863d-9e99c92acb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:03.681895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ba935-6af0-4a54-863d-9e99c92acb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:03.683885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ba935-6af0-4a54-863d-9e99c92acb39 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:03.697203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1290/2568] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:38:03.703227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:03.726585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035227-9feb-4ee9-a673-0acfc761c06b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:03.736167 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:03.737628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:03.737628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:03.737628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] PATH_INFO: `/v3/projects/9100a9e4a1604661870c3bbc2433782c/users/6a8e0a0c3a72440188776f80493d4cfa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:03.746502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9100a9e4a1604661870c3bbc2433782c, user_id=6a8e0a0c3a72440188776f80493d4cfa, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:03.749893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:03.771419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1279/2569] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:03 2022] PUT /identity/v3/projects/9100a9e4a1604661870c3bbc2433782c/users/6a8e0a0c3a72440188776f80493d4cfa/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:03.783658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:03.784276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:03.784618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:03.819818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] MFA Rules not processed for user `6a8e0a0c3a72440188776f80493d4cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:03.820997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:03.969556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1291/2570] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:03.984018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:03.986423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:04.061987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971347da-3c34-4b17-8331-792ee135ff3e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:04.066918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1f0db-a6e5-4119-8a47-c7d495bf9547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:04.067841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1f0db-a6e5-4119-8a47-c7d495bf9547 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:04.068136 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1f0db-a6e5-4119-8a47-c7d495bf9547 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:04.068402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1f0db-a6e5-4119-8a47-c7d495bf9547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:04.147904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1f0db-a6e5-4119-8a47-c7d495bf9547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:04.149931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1f0db-a6e5-4119-8a47-c7d495bf9547 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:04.161586 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1280/2571] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:08.472185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:08.473434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:08.546849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29163d79-f3cc-4374-a594-314ca44f3a8b None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:08.551537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:08.552170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:08.552453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:08.552726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] PATH_INFO: `/v3/users/8e3a08fef51b4cb3a3359b827e069d0f` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:08.553967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3a08fef51b4cb3a3359b827e069d0f)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:08.555851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:08.778435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:08.782765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3a08fef51b4cb3a3359b827e069d0f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:08.796605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3a08fef51b4cb3a3359b827e069d0f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:08.797365 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3a08fef51b4cb3a3359b827e069d0f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:08.804578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3a08fef51b4cb3a3359b827e069d0f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:08.884121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3a08fef51b4cb3a3359b827e069d0f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:08.892990 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1292/2572] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:08 2022] DELETE /identity/v3/users/8e3a08fef51b4cb3a3359b827e069d0f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:08.897862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:08.899904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:08.900522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:08.925006 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:08.926445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:08.975295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:08.999405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1281/2573] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:38:09.010607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:09.011613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:09.080702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470ea38-d8a3-4c52-9c31-a9b779092939 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:09.084349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210950-6284-4154-9301-fcc0535378cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:09.084953 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210950-6284-4154-9301-fcc0535378cb service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:09.085255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210950-6284-4154-9301-fcc0535378cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:09.085516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210950-6284-4154-9301-fcc0535378cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:09.095354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3210950-6284-4154-9301-fcc0535378cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:09.096760 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3210950-6284-4154-9301-fcc0535378cb service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:09.106615 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1293/2574] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:10.577838 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:10.579623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:10.611886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82aa97-02e1-4918-8159-c8571dba4f56 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:10.627341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:10.629140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:10.629328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:10.630240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] PATH_INFO: `/v3/projects/4d9c054ae00a422d811b56e8328a1d3e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:10.637787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9c054ae00a422d811b56e8328a1d3e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:10.641040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:10.803327 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9c054ae00a422d811b56e8328a1d3e', 'request_id': 'req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:10.812226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9c054ae00a422d811b56e8328a1d3e', 'request_id': 'req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:10.821330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9c054ae00a422d811b56e8328a1d3e', 'request_id': 'req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:10.964740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] The token cache is being invalidate because project 4d9c054ae00a422d811b56e8328a1d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:10.965028 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:10.966215 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4d3d0bfa-94ca-486f-9e7b-380fe98b38e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:10.967659 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1282/2575] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:10 2022] DELETE /identity/v3/projects/4d9c054ae00a422d811b56e8328a1d3e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:10.972782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d311-6dfa-446d-a57b-69c8e27f3146 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:10.973352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d311-6dfa-446d-a57b-69c8e27f3146 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:10.973352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d311-6dfa-446d-a57b-69c8e27f3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:10.998658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ac96d311-6dfa-446d-a57b-69c8e27f3146 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:11.001085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ac96d311-6dfa-446d-a57b-69c8e27f3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:11.080333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1294/2576] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:11.088670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84b8b4-f264-48e0-9c4b-295b9295442a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.088964 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84b8b4-f264-48e0-9c4b-295b9295442a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.089283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84b8b4-f264-48e0-9c4b-295b9295442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.110620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-bf84b8b4-f264-48e0-9c4b-295b9295442a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:11.115143 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-bf84b8b4-f264-48e0-9c4b-295b9295442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:11.121922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1283/2577] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:11.127445 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d311-6dfa-446d-a57b-69c8e27f3146 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.137927 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d311-6dfa-446d-a57b-69c8e27f3146 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.142970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.143599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.143877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.144332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.145208 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:38:11.145514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.147740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.161523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1295/2578] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:38:11.172341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84b8b4-f264-48e0-9c4b-295b9295442a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.177533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84b8b4-f264-48e0-9c4b-295b9295442a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.182975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.183754 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.184041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.184312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.185620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.190904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.285903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1284/2579] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:11 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:11.290410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.301410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2c97-ae61-47d5-855b-b9c37fee8ac4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.357945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:11.368712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.369370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.369645 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.369936 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.370605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.373353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.475939 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1296/2580] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:11 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:11.477480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.490336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c5e48-0fb6-4532-8dcc-a185deb13d58 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.496273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.496998 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.497419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.502075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.502075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.502075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.513041 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1285/2581] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:11.517185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.536539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1301-9038-49c8-a640-8bb3eeeddb70 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.536539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4fa6b-6dde-4f8a-8859-17ab20341a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.536539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4fa6b-6dde-4f8a-8859-17ab20341a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.536539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4fa6b-6dde-4f8a-8859-17ab20341a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.536905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4fa6b-6dde-4f8a-8859-17ab20341a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.536905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4fa6b-6dde-4f8a-8859-17ab20341a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.539153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4fa6b-6dde-4f8a-8859-17ab20341a90 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.555011 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1297/2582] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:11.559718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.571284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01371ef-1e7d-4e1e-9b4d-cb28009c9d97 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.576365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.582353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.582353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.582353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] PATH_INFO: `/v3/projects/13b2061227b24ea1b276e819aad7b197/users/ef6fc0b1bf4849a6a3ce2ecfb80a5d03/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.594739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b2061227b24ea1b276e819aad7b197, user_id=ef6fc0b1bf4849a6a3ce2ecfb80a5d03, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.597560 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.741456 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1286/2583] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:11 2022] PUT /identity/v3/projects/13b2061227b24ea1b276e819aad7b197/users/ef6fc0b1bf4849a6a3ce2ecfb80a5d03/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:11.752597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce051bc9-4e93-4a46-bf2c-87b9e54bdfb8 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.753633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce051bc9-4e93-4a46-bf2c-87b9e54bdfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.754187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce051bc9-4e93-4a46-bf2c-87b9e54bdfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.787347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ce051bc9-4e93-4a46-bf2c-87b9e54bdfb8 None None] MFA Rules not processed for user `ef6fc0b1bf4849a6a3ce2ecfb80a5d03`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:11.787746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ce051bc9-4e93-4a46-bf2c-87b9e54bdfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:11.790122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.792075 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:11.860848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706d5-1192-4b0a-b56b-73f384d1cbf9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.865440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.866227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.866609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.866981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.869352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1298/2584] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:38:11.869934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:11.874724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce051bc9-4e93-4a46-bf2c-87b9e54bdfb8 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:11.886260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:11.947087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce051bc9-4e93-4a46-bf2c-87b9e54bdfb8 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:11.953337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:11.953913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:11.954569 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:11.954848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:11.955489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.955583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:11.956805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.957964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:11.968451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1287/2585] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:38:12.046858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1299/2586] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:11 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:12.051336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:12.058604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71143268-2299-461c-af25-f2a6239a4433 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:12.121570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:12.122168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:12.123040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:12.123348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:12.123953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:12.126005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:12.237844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1288/2587] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:12 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:38:12.243491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:12.250750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11649c-8e8e-4f16-915f-8c659b2e3e12 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:12.255918 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:12.256631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:12.256978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:12.257318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:12.257958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:12.259553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:12.270153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1300/2588] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:12.274418 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:12.293462 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9979e0-eb7f-4fe5-b6d2-30b36a8f15f3 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:12.298357 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6cbc5-30a8-42c7-9cbb-11003ebe923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:12.299317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6cbc5-30a8-42c7-9cbb-11003ebe923d admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:12.299489 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6cbc5-30a8-42c7-9cbb-11003ebe923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:12.299749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6cbc5-30a8-42c7-9cbb-11003ebe923d admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:12.300396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6cbc5-30a8-42c7-9cbb-11003ebe923d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:12.302051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6cbc5-30a8-42c7-9cbb-11003ebe923d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:12.313910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1289/2589] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:12.320599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:12.331382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0070-2cc9-4d13-819d-28b25b65d094 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:12.336523 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:12.337453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:12.337600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:12.337817 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] PATH_INFO: `/v3/projects/b9b4ad6cfd6841888f38b1a2a0068f07/users/c2ab5921470847f0a8bf0ccf0c1d991c/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:12.354395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b4ad6cfd6841888f38b1a2a0068f07, user_id=c2ab5921470847f0a8bf0ccf0c1d991c, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:12.357737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:12.476895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1301/2590] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:12 2022] PUT /identity/v3/projects/b9b4ad6cfd6841888f38b1a2a0068f07/users/c2ab5921470847f0a8bf0ccf0c1d991c/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:12.490938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c91aa-862e-406e-8238-34175bb5688a None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:12.491227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c91aa-862e-406e-8238-34175bb5688a None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:12.491505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c91aa-862e-406e-8238-34175bb5688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:12.523994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-583c91aa-862e-406e-8238-34175bb5688a None None] MFA Rules not processed for user `c2ab5921470847f0a8bf0ccf0c1d991c`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:12.525272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-583c91aa-862e-406e-8238-34175bb5688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:12.595419 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1290/2591] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:12.600290 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:12.614591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:12.678425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125376d-2a57-46bb-8817-d5f821a48ef5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:12.683330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:12.683933 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:12.684211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:12.684483 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:12.685153 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:12.687031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:12.796601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1302/2592] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:12 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:12.801522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c91aa-862e-406e-8238-34175bb5688a None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:12.823633 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c91aa-862e-406e-8238-34175bb5688a None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:12.860775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:12.908407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:12.910424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:12.910424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:12.910424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:12.910737 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:12.917358 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:13.064272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1291/2593] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:12 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:38:13.070979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:13.081995 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69accb32-c379-4fcf-adf3-abe67bde5f2b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:13.087832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:13.089259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:13.089259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:13.089259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:13.089739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:13.091434 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:13.114957 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1303/2594] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:38:13.120228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:13.133110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d01d-2ace-4d2e-bf19-6c06bcfe36e9 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:13.138905 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:13.139685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:13.140072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:13.140546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] PATH_INFO: `/v3/projects/82c7cce0654b4488a1737df918da11d4/users/0e388c8ab66944dbab73f5045315853d/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:13.159438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c7cce0654b4488a1737df918da11d4, user_id=0e388c8ab66944dbab73f5045315853d, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:13.162315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:13.244788 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1292/2595] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:13 2022] PUT /identity/v3/projects/82c7cce0654b4488a1737df918da11d4/users/0e388c8ab66944dbab73f5045315853d/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:13.249106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:13.260155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258cbd-8485-46a1-9e84-a58ea2904c12 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:13.330028 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32e611-fdc4-4cc1-99af-9cb17c16fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:13.330908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e611-fdc4-4cc1-99af-9cb17c16fca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:13.331912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e611-fdc4-4cc1-99af-9cb17c16fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:13.331912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e611-fdc4-4cc1-99af-9cb17c16fca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:13.332879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32e611-fdc4-4cc1-99af-9cb17c16fca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:13.334764 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32e611-fdc4-4cc1-99af-9cb17c16fca4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:13.346819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1304/2596] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:13.351383 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:13.363790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92102ebc-16a7-4a69-96bd-03c1196f2c7d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:13.368950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:13.370097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:13.370404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:13.370711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] PATH_INFO: `/v3/projects/82c7cce0654b4488a1737df918da11d4/users/0e388c8ab66944dbab73f5045315853d/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:13.373300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c7cce0654b4488a1737df918da11d4, user_id=0e388c8ab66944dbab73f5045315853d, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:13.376424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:13.390452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1293/2597] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:13 2022] PUT /identity/v3/projects/82c7cce0654b4488a1737df918da11d4/users/0e388c8ab66944dbab73f5045315853d/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:38:13.404021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547df3-97ea-473f-b1a0-0cea673d1bf6 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:13.404590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547df3-97ea-473f-b1a0-0cea673d1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:13.404986 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547df3-97ea-473f-b1a0-0cea673d1bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:13.467798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-84547df3-97ea-473f-b1a0-0cea673d1bf6 None None] MFA Rules not processed for user `0e388c8ab66944dbab73f5045315853d`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:13.470884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-84547df3-97ea-473f-b1a0-0cea673d1bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:13.569751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1305/2598] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:13.582040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:13.646919 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6d96b-defc-4c19-bd69-ebf64e779a67 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:13.650959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:13.651565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:13.651849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:13.652127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:13.711234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:13.713318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:13.725867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1294/2599] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:14.316164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aeb04-8352-4b4b-9ecf-83ce75d72301 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:14.316737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aeb04-8352-4b4b-9ecf-83ce75d72301 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:14.316737 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aeb04-8352-4b4b-9ecf-83ce75d72301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:14.323468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:14.358524 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a45aeb04-8352-4b4b-9ecf-83ce75d72301 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:14.359989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a45aeb04-8352-4b4b-9ecf-83ce75d72301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:14.462234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1306/2600] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:14.475297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:14.477615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:14.508047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:14.552111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973a79-c541-47c8-a4e3-293ed7964ec7 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:14.570081 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:14.571087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:14.571346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:14.571862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:14.589266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:14.592769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:14.610518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1295/2601] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:38:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:38:16.191300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aeb04-8352-4b4b-9ecf-83ce75d72301 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:16.201333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aeb04-8352-4b4b-9ecf-83ce75d72301 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:16.205571 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cef90-4de7-44f0-986f-da2011d66b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:16.206185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cef90-4de7-44f0-986f-da2011d66b29 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:16.206463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cef90-4de7-44f0-986f-da2011d66b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:16.206740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cef90-4de7-44f0-986f-da2011d66b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:16.280210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cef90-4de7-44f0-986f-da2011d66b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:16.280210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cef90-4de7-44f0-986f-da2011d66b29 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:16.287962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1307/2602] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:18.072274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:18.083052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6a231-36bd-40dd-a6bc-b4169b2c25cf service swift] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:18.086948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:18.087640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:18.087992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:18.088336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:18.099398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:18.101114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:18.111276 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1296/2603] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:18.435572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:18.436156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:18.436156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:18.458372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:18.459595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:18.466972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1308/2604] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:18.479492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:18.491436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934333b5-288f-41da-857f-462d552d9edd service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:18.497241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0191b-8085-4170-bac1-272343760e68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:18.497819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0191b-8085-4170-bac1-272343760e68 service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:18.498097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0191b-8085-4170-bac1-272343760e68 service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:18.498368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0191b-8085-4170-bac1-272343760e68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:18.506699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0191b-8085-4170-bac1-272343760e68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:18.508292 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0191b-8085-4170-bac1-272343760e68 service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:18.517047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1297/2605] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:38:18.775811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:18.778185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:18.862666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6de2e6-bfc5-49fd-9454-0ba577bf2116 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:18.867585 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:18.868217 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:18.868505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:18.868778 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] PATH_INFO: `/v3/users/4da26c5237034d4eaf557e652b55c644` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:18.870100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da26c5237034d4eaf557e652b55c644)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:18.872747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:18.989605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:19.135555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da26c5237034d4eaf557e652b55c644'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:19.151387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da26c5237034d4eaf557e652b55c644'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:19.152251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da26c5237034d4eaf557e652b55c644'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:19.161031 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da26c5237034d4eaf557e652b55c644'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:19.232855 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da26c5237034d4eaf557e652b55c644'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:19.240554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1309/2606] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:18 2022] DELETE /identity/v3/users/4da26c5237034d4eaf557e652b55c644 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:19.245267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:19.246099 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:19.246533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:19.267849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:19.269392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:19.357052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1298/2607] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:19.368096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:19.370252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:19.479629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2fe47-d403-488d-bc7a-533e46575c81 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:19.484027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:19.484630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:19.484907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:19.485206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:19.495257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:19.497026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:19.509979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1310/2608] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:20.082049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:20.089405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:20.128148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a23e-c149-4ce0-a34b-5c36b6add6a2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:20.137228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:20.138112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:20.138543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:20.138832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] PATH_INFO: `/v3/projects/e339cd17850443efaa692bd49e223a55` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:20.140368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e339cd17850443efaa692bd49e223a55)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:20.142871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:20.370521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e339cd17850443efaa692bd49e223a55', 'request_id': 'req-ff53a6ac-3032-48e1-921d-ebc8a242e431'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.378284 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e339cd17850443efaa692bd49e223a55', 'request_id': 'req-ff53a6ac-3032-48e1-921d-ebc8a242e431'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.387146 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e339cd17850443efaa692bd49e223a55', 'request_id': 'req-ff53a6ac-3032-48e1-921d-ebc8a242e431'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.488044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] The token cache is being invalidate because project e339cd17850443efaa692bd49e223a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:20.488398 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.489452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.492792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1299/2609] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:20 2022] DELETE /identity/v3/projects/e339cd17850443efaa692bd49e223a55 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:20.498784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:20.522696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f273c-c8d5-4c6d-a41a-e50d590098a8 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:20.610577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:20.611538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:20.611818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:20.612199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] PATH_INFO: `/v3/users/6a8e0a0c3a72440188776f80493d4cfa` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:20.613583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8e0a0c3a72440188776f80493d4cfa)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:20.615785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:20.881471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:20.895824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8e0a0c3a72440188776f80493d4cfa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.917816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8e0a0c3a72440188776f80493d4cfa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.919492 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8e0a0c3a72440188776f80493d4cfa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:20.930938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8e0a0c3a72440188776f80493d4cfa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:21.026701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4013fc14-f0ad-4bf4-8f0b-128380bab2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8e0a0c3a72440188776f80493d4cfa'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:21.039650 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1311/2610] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:20 2022] DELETE /identity/v3/users/6a8e0a0c3a72440188776f80493d4cfa => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:38:21.556934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:21.558689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:21.579953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a6ac-3032-48e1-921d-ebc8a242e431 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:21.600665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:21.686652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:21.690289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:21.690289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:21.690289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] PATH_INFO: `/v3/projects/9100a9e4a1604661870c3bbc2433782c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:21.690289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9100a9e4a1604661870c3bbc2433782c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:21.691745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:22.070716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9100a9e4a1604661870c3bbc2433782c', 'request_id': 'req-d8c2a5b4-3e11-4712-a084-d53c621a07e0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:22.076923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9100a9e4a1604661870c3bbc2433782c', 'request_id': 'req-d8c2a5b4-3e11-4712-a084-d53c621a07e0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:22.083446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9100a9e4a1604661870c3bbc2433782c', 'request_id': 'req-d8c2a5b4-3e11-4712-a084-d53c621a07e0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:22.176371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] The token cache is being invalidate because project 9100a9e4a1604661870c3bbc2433782c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:22.176930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:22.178032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d8c2a5b4-3e11-4712-a084-d53c621a07e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:22.182151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1300/2611] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:21 2022] DELETE /identity/v3/projects/9100a9e4a1604661870c3bbc2433782c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:22.188461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07bd3b-7d0b-4a93-88e8-1ac1e092eedc None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.188965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07bd3b-7d0b-4a93-88e8-1ac1e092eedc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.189083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07bd3b-7d0b-4a93-88e8-1ac1e092eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.214558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-af07bd3b-7d0b-4a93-88e8-1ac1e092eedc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:22.215887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-af07bd3b-7d0b-4a93-88e8-1ac1e092eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:22.293004 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1312/2612] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:22.301792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf06a-9ed4-4b44-bc48-4e8a37884fd2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.302070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf06a-9ed4-4b44-bc48-4e8a37884fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.313647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf06a-9ed4-4b44-bc48-4e8a37884fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.325596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-4dfcf06a-9ed4-4b44-bc48-4e8a37884fd2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:22.326776 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4dfcf06a-9ed4-4b44-bc48-4e8a37884fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:22.334915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1301/2613] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:22.339533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07bd3b-7d0b-4a93-88e8-1ac1e092eedc None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:22.351747 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07bd3b-7d0b-4a93-88e8-1ac1e092eedc None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:22.358012 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:22.358746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.359025 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.359447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.359894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:38:22.360205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:22.362360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:22.376540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1313/2614] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:38:22.382312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcf06a-9ed4-4b44-bc48-4e8a37884fd2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:22.394135 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcf06a-9ed4-4b44-bc48-4e8a37884fd2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:22.402341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:22.403010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.403278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.403546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.404207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:22.406133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:22.545784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:22.546199 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1302/2615] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:22 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:22.559775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cab337-e2ad-4d03-ab55-e70050b6a43c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:22.638897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:22.639543 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.639888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.640227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.640954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:22.643119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:22.754100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1314/2616] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:22 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:22.755584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:22.769045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983915f-9838-4cf7-9347-664260561eec admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:22.789997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:22.790813 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.794031 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.794815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.795966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:22.800723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:22.821657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1303/2617] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:22.826254 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:22.848091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e969f7-1e67-4950-b8cf-ab86252be879 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:22.860486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4a57f-73fd-44da-8556-f9ffdc27e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:22.863182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a57f-73fd-44da-8556-f9ffdc27e791 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.863182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a57f-73fd-44da-8556-f9ffdc27e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.863182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a57f-73fd-44da-8556-f9ffdc27e791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.863182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4a57f-73fd-44da-8556-f9ffdc27e791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:22.864765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4a57f-73fd-44da-8556-f9ffdc27e791 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:22.877733 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1315/2618] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:22.882468 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:22.897580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4105c6-3b0c-4002-9cf9-b9af534b2f88 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:22.900316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:22.901052 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:22.901465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:22.901812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] PATH_INFO: `/v3/projects/50c21534b8794056a5ee73e52c91e4b7/users/8f795a0d5c77417ea8f4277482731dfb/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:22.920324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c21534b8794056a5ee73e52c91e4b7, user_id=8f795a0d5c77417ea8f4277482731dfb, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:22.926293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:23.062835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1304/2619] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:22 2022] PUT /identity/v3/projects/50c21534b8794056a5ee73e52c91e4b7/users/8f795a0d5c77417ea8f4277482731dfb/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:23.077267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a94f7-40be-407b-9327-d71f67f50eae None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:23.077626 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a94f7-40be-407b-9327-d71f67f50eae None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:23.077834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a94f7-40be-407b-9327-d71f67f50eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:23.116775 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:23.121021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6e4a94f7-40be-407b-9327-d71f67f50eae None None] MFA Rules not processed for user `8f795a0d5c77417ea8f4277482731dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:23.122732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6e4a94f7-40be-407b-9327-d71f67f50eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:23.209474 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1316/2620] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:23.227096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:23.229424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:23.283472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:23.341366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429bef0-d59a-44f4-94a4-36d08abd941f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:23.347917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df98b3-7e09-4650-b62f-3a2d7556f7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:23.348664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df98b3-7e09-4650-b62f-3a2d7556f7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:23.348979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df98b3-7e09-4650-b62f-3a2d7556f7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:23.349287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df98b3-7e09-4650-b62f-3a2d7556f7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:23.360890 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df98b3-7e09-4650-b62f-3a2d7556f7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:23.362758 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df98b3-7e09-4650-b62f-3a2d7556f7f5 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:23.379079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1305/2621] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:38:23.415367 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a94f7-40be-407b-9327-d71f67f50eae None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:23.507131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a94f7-40be-407b-9327-d71f67f50eae None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:23.513842 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:23.514611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:23.514901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:23.515240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] PATH_INFO: `/v3/users/8f795a0d5c77417ea8f4277482731dfb` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:23.516703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f795a0d5c77417ea8f4277482731dfb)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:23.519070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:23.737808 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f795a0d5c77417ea8f4277482731dfb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:23.752849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f795a0d5c77417ea8f4277482731dfb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:23.753616 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f795a0d5c77417ea8f4277482731dfb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:23.763127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f795a0d5c77417ea8f4277482731dfb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:23.841220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f795a0d5c77417ea8f4277482731dfb'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:23.854671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1317/2622] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:23 2022] DELETE /identity/v3/users/8f795a0d5c77417ea8f4277482731dfb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:23.859849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:23.860401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:23.860656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:23.888023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:23.893160 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:24.019506 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1306/2623] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:24.041672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:24.043446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:24.076949 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:24.119785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f548f2-a42d-4746-86ac-be77868ef9ed admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:24.125594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:24.126357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:24.126917 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:24.127211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:24.139911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:24.141496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:24.160678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1318/2624] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:24.300228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:24.303040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:24.320111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca0f90-6c6d-47a1-ad1c-6149dd84ed10 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:24.325881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:24.326558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:24.326965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:24.327253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] PATH_INFO: `/v3/users/ef6fc0b1bf4849a6a3ce2ecfb80a5d03` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:24.328665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6fc0b1bf4849a6a3ce2ecfb80a5d03)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:24.330775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:24.567747 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6fc0b1bf4849a6a3ce2ecfb80a5d03'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:24.590452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6fc0b1bf4849a6a3ce2ecfb80a5d03'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:24.600759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6fc0b1bf4849a6a3ce2ecfb80a5d03'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:24.696966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:24.696966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:24.712802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c509cd-ab5c-42a9-ab26-3bdf58a1ccff service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:24.719172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:24.719712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:24.720130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:24.720519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] PATH_INFO: `/v3/projects/50c21534b8794056a5ee73e52c91e4b7` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:24.722864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c21534b8794056a5ee73e52c91e4b7)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:24.725580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:24.729172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6fc0b1bf4849a6a3ce2ecfb80a5d03'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:24.730022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7c334ecf-dccd-4b76-a306-a47d772b18f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6fc0b1bf4849a6a3ce2ecfb80a5d03'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:24.749676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1307/2625] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:24 2022] DELETE /identity/v3/users/ef6fc0b1bf4849a6a3ce2ecfb80a5d03 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:24.751564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:24.751736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:24.751908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:24.811638 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:24.813885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:24.866631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:24.879326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c21534b8794056a5ee73e52c91e4b7', 'request_id': 'req-33bdfe47-fc40-4454-8d19-5d8068e188ca'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:24.915092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1308/2626] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:24.926671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:24.928251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:25.011620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c21534b8794056a5ee73e52c91e4b7', 'request_id': 'req-33bdfe47-fc40-4454-8d19-5d8068e188ca'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:25.013269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28722e78-a6f6-4e5e-afcd-8f10959bb317 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.022388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c21534b8794056a5ee73e52c91e4b7', 'request_id': 'req-33bdfe47-fc40-4454-8d19-5d8068e188ca'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:25.038688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] The token cache is being invalidate because project 50c21534b8794056a5ee73e52c91e4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:25.039127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:25.040000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-33bdfe47-fc40-4454-8d19-5d8068e188ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:25.041946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1319/2627] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:24 2022] DELETE /identity/v3/projects/50c21534b8794056a5ee73e52c91e4b7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:38:25.047604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933882-32e3-499e-bf6a-5c91181b52dc None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.047970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933882-32e3-499e-bf6a-5c91181b52dc None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.048253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933882-32e3-499e-bf6a-5c91181b52dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.075791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-4d933882-32e3-499e-bf6a-5c91181b52dc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:25.077022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4d933882-32e3-499e-bf6a-5c91181b52dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:25.080927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.082843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.082843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.082843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.086699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:25.153023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.153600 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1320/2628] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:38:25.154588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:25.161362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699f7d-3395-4acb-a1cd-cdd1c8fb53ed None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.161644 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699f7d-3395-4acb-a1cd-cdd1c8fb53ed None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.161916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699f7d-3395-4acb-a1cd-cdd1c8fb53ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.166710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1309/2629] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:38:25.187181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b9699f7d-3395-4acb-a1cd-cdd1c8fb53ed None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:25.188093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b9699f7d-3395-4acb-a1cd-cdd1c8fb53ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:25.197226 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1321/2630] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:25.201979 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:25.211689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240956f-45dd-44de-ae95-d1c0956a925f service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.217256 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.217959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.218494 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.218642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.219235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:38:25.219542 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.221246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:25.237743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1310/2631] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:38:25.242225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699f7d-3395-4acb-a1cd-cdd1c8fb53ed None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:25.252478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699f7d-3395-4acb-a1cd-cdd1c8fb53ed None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.260079 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.260703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.260979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.261278 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.261948 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.263867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:25.413564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1322/2632] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:25.417968 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:25.432892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b24b-966b-4d1c-87d6-c1edaab6fd31 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.503556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.504603 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.504888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.505200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.506003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.508267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:25.515389 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:25.686689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1311/2633] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:25 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:25.702928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:25.715467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0c28-6862-4bd5-90d2-c2200fbda004 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.722548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.723173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.723456 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.723725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.724382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.726314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:25.737666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:25.739067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:25.751472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1323/2634] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:25.752575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:25.766689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b894bd-4c57-4af0-982e-cedd3aad89e4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.784690 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.785648 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.786100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.786769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.787740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.789954 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:25.793202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:25.798058 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821ad0-7f84-4542-8ab1-30ad77e45769 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.803673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1324/2635] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:25.811518 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.812315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.812722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.813091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] PATH_INFO: `/v3/projects/13b2061227b24ea1b276e819aad7b197` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.814404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b2061227b24ea1b276e819aad7b197)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.814533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:25.816718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:25.826757 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb841-4c1d-4e52-996c-c865a58fd9e8 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:25.833394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dce95e-053b-4811-aed4-4d9ca7345261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:25.834106 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dce95e-053b-4811-aed4-4d9ca7345261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:25.834384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dce95e-053b-4811-aed4-4d9ca7345261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:25.834829 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dce95e-053b-4811-aed4-4d9ca7345261 admin admin] PATH_INFO: `/v3/projects/ebe42d9914fb472dab2ff9c3a18fbf99/users/684b1a08185b42318ee7a0ede872b599/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:25.857941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dce95e-053b-4811-aed4-4d9ca7345261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe42d9914fb472dab2ff9c3a18fbf99, user_id=684b1a08185b42318ee7a0ede872b599, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:25.860749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dce95e-053b-4811-aed4-4d9ca7345261 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:26.002718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1325/2636] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:25 2022] PUT /identity/v3/projects/ebe42d9914fb472dab2ff9c3a18fbf99/users/684b1a08185b42318ee7a0ede872b599/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:38:26.008784 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:26.009053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:26.009411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:26.024201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b2061227b24ea1b276e819aad7b197', 'request_id': 'req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.037762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b2061227b24ea1b276e819aad7b197', 'request_id': 'req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.044020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:26.046082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:26.049124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b2061227b24ea1b276e819aad7b197', 'request_id': 'req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.148348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] The token cache is being invalidate because project 13b2061227b24ea1b276e819aad7b197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:26.148906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.149934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.151739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1312/2637] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:25 2022] DELETE /identity/v3/projects/13b2061227b24ea1b276e819aad7b197 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:26.157867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1326/2638] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:26.159632 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:26.161563 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:26.166719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:26.169372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:26.181112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afceb49-c16c-4de1-8cd9-02bb1c3063e1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:26.191156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:26.192286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:26.192806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:26.193364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] PATH_INFO: `/v3/users/c2ab5921470847f0a8bf0ccf0c1d991c` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:26.195402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ab5921470847f0a8bf0ccf0c1d991c)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:26.198259 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:26.248070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8d8f-21f0-4682-91d9-c5e34800fa94 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:26.253458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:26.254096 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:26.254272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:26.254547 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:26.256387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:26.270113 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:26.271557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:26.285173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1327/2639] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:38:26.464644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ab5921470847f0a8bf0ccf0c1d991c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.482621 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ab5921470847f0a8bf0ccf0c1d991c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.498963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ab5921470847f0a8bf0ccf0c1d991c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.588537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ab5921470847f0a8bf0ccf0c1d991c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.589601 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ab5921470847f0a8bf0ccf0c1d991c'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:26.601379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1313/2640] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:26 2022] DELETE /identity/v3/users/c2ab5921470847f0a8bf0ccf0c1d991c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:38:27.476559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:27.493849 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896472a8-eae1-4751-86f8-bd3ba4feb7a5 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:27.630415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:27.632009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:27.632661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:27.633359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] PATH_INFO: `/v3/projects/b9b4ad6cfd6841888f38b1a2a0068f07` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:27.635627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b4ad6cfd6841888f38b1a2a0068f07)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:27.640064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:27.671148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:27.855906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b4ad6cfd6841888f38b1a2a0068f07', 'request_id': 'req-0243e996-d1b6-429d-bb70-ae935d0c6258'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:27.951599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b4ad6cfd6841888f38b1a2a0068f07', 'request_id': 'req-0243e996-d1b6-429d-bb70-ae935d0c6258'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:27.959794 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b4ad6cfd6841888f38b1a2a0068f07', 'request_id': 'req-0243e996-d1b6-429d-bb70-ae935d0c6258'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:27.983442 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] The token cache is being invalidate because project b9b4ad6cfd6841888f38b1a2a0068f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:27.984083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:27.985192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-0243e996-d1b6-429d-bb70-ae935d0c6258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:27.987637 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1328/2641] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:27 2022] DELETE /identity/v3/projects/b9b4ad6cfd6841888f38b1a2a0068f07 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:27.991932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:27.993624 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:28.010955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96096c4-d2e5-4789-872b-25e8ea14c870 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:28.019872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.136767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:28.136767 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:28.137179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:28.137179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] PATH_INFO: `/v3/users/0e388c8ab66944dbab73f5045315853d` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:28.139089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e388c8ab66944dbab73f5045315853d)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:28.141643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:28.161846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:28.161846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:28.163756 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:28.238956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] MFA Rules not processed for user `684b1a08185b42318ee7a0ede872b599`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:28.240184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:28.329992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1329/2642] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:38:28.346813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:28.348679 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:28.439091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e388c8ab66944dbab73f5045315853d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:28.447665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eae108-73f5-46f8-b541-3cd58fc74c44 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:28.452601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:28.453273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:28.459901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:28.459901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:28.461671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e388c8ab66944dbab73f5045315853d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:28.466824 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:28.468288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:28.476516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e388c8ab66944dbab73f5045315853d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:28.484958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1330/2643] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:38:28.891363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e388c8ab66944dbab73f5045315853d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:28.892044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-171193d7-dbd2-4fab-852d-3a1f463b943f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e388c8ab66944dbab73f5045315853d'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:28.900819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1314/2644] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:27 2022] DELETE /identity/v3/users/0e388c8ab66944dbab73f5045315853d => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:29.512411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:29.515742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:29.560642 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd112eb-908c-4428-a218-1d1d59f56c94 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:29.640938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:29.690668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:29.691956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:29.692556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:29.693203 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] PATH_INFO: `/v3/projects/82c7cce0654b4488a1737df918da11d4` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:29.695751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c7cce0654b4488a1737df918da11d4)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:29.699846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:29.949962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c7cce0654b4488a1737df918da11d4', 'request_id': 'req-a292d7cd-3c53-48f3-b441-bb75222459f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:30.085921 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c7cce0654b4488a1737df918da11d4', 'request_id': 'req-a292d7cd-3c53-48f3-b441-bb75222459f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:30.093055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c7cce0654b4488a1737df918da11d4', 'request_id': 'req-a292d7cd-3c53-48f3-b441-bb75222459f5'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:30.110554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] The token cache is being invalidate because project 82c7cce0654b4488a1737df918da11d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:30.110839 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:30.111546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-a292d7cd-3c53-48f3-b441-bb75222459f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:30.113149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1331/2645] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:29 2022] DELETE /identity/v3/projects/82c7cce0654b4488a1737df918da11d4 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:30.118267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1d83-cbf0-47a0-b39a-0d665e718f71 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.119035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1d83-cbf0-47a0-b39a-0d665e718f71 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.119035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1d83-cbf0-47a0-b39a-0d665e718f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.144839 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-018f1d83-cbf0-47a0-b39a-0d665e718f71 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:30.146148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-018f1d83-cbf0-47a0-b39a-0d665e718f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:30.225897 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1315/2646] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:30.236508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a614a3-2345-4483-93a8-361a7ce7a3c1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.236793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a614a3-2345-4483-93a8-361a7ce7a3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.237099 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a614a3-2345-4483-93a8-361a7ce7a3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.258612 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-21a614a3-2345-4483-93a8-361a7ce7a3c1 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:30.259913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-21a614a3-2345-4483-93a8-361a7ce7a3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:30.278497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1332/2647] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:30.279981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1d83-cbf0-47a0-b39a-0d665e718f71 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:30.295072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1d83-cbf0-47a0-b39a-0d665e718f71 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:30.302566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:30.303596 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.304059 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.304490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.305652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:38:30.306188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:30.309732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:30.329602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1316/2648] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:38:30.334944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a614a3-2345-4483-93a8-361a7ce7a3c1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:30.345048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a614a3-2345-4483-93a8-361a7ce7a3c1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:30.350127 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:30.350729 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.351007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.351279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.351916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:30.353906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:30.491428 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1333/2649] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:30 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:30.496841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:30.509795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97110a39-b243-41c5-b6f3-ee3623f11bb3 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:30.528363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:30.606384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:30.606908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.607186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.607453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.608103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:30.610224 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:30.759340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1317/2650] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:30 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:38:30.764932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:30.786944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750f9df-95e7-4a9d-a4eb-8032ea850f71 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:30.797040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:30.798189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.798708 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.799187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.800688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:30.803701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:30.821792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1334/2651] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:38:30.829369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:30.853463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37fd4-c03b-442d-9a9c-0aafa634d589 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:30.871273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996e6d-a29d-485f-bb8e-6eca4e997732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:30.872723 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996e6d-a29d-485f-bb8e-6eca4e997732 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.873539 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996e6d-a29d-485f-bb8e-6eca4e997732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.874019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996e6d-a29d-485f-bb8e-6eca4e997732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.875668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996e6d-a29d-485f-bb8e-6eca4e997732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:30.879034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996e6d-a29d-485f-bb8e-6eca4e997732 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:30.898909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1318/2652] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:30.904103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:30.915362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d939e-fc95-4c3f-a77d-d5190b764aea admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:30.925992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:30.926804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:30.927411 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:30.927979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] PATH_INFO: `/v3/projects/29dbd9901856475880879ff0c64c874d/users/283e344437594357925fead9c0b2f498/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:30.956601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29dbd9901856475880879ff0c64c874d, user_id=283e344437594357925fead9c0b2f498, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:30.959950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:31.099166 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1335/2653] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:30 2022] PUT /identity/v3/projects/29dbd9901856475880879ff0c64c874d/users/283e344437594357925fead9c0b2f498/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:31.101413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac74f5-7ff7-4e5a-b845-92e80b630640 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:31.101753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac74f5-7ff7-4e5a-b845-92e80b630640 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:31.102175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac74f5-7ff7-4e5a-b845-92e80b630640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:31.123844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a7ac74f5-7ff7-4e5a-b845-92e80b630640 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:31.125273 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a7ac74f5-7ff7-4e5a-b845-92e80b630640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:31.203226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1319/2654] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:31.213970 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:31.216240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:31.286114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122356b-e2bc-4779-a03c-f5be609aeb68 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:31.293801 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:31.294607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:31.294881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:31.295149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:31.304904 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:31.306359 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:31.318066 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1336/2655] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:31.809992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8767-51e0-43f3-9502-1bd735bae478 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:31.810520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8767-51e0-43f3-9502-1bd735bae478 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:31.810520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8767-51e0-43f3-9502-1bd735bae478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:31.858100 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3bca8767-51e0-43f3-9502-1bd735bae478 None None] MFA Rules not processed for user `684b1a08185b42318ee7a0ede872b599`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:31.864645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3bca8767-51e0-43f3-9502-1bd735bae478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:31.990572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1320/2656] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:38:32.284363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:32.286670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:32.299521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bdefd-d6fb-4ce7-9ea6-712ebe09b507 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:32.304572 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:32.305120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:32.305404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:32.305678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:32.307484 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:32.315578 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:32.318647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:32.320441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:32.332477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1337/2657] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:38.308421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598170-f371-4d56-bd43-05a1dd61b0e6 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:38.309600 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598170-f371-4d56-bd43-05a1dd61b0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:38.310233 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598170-f371-4d56-bd43-05a1dd61b0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:38.339965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-10598170-f371-4d56-bd43-05a1dd61b0e6 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:38.339965 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-10598170-f371-4d56-bd43-05a1dd61b0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:38.379685 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:38.410214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1321/2658] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 21:38:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:38.428248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:38.429858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:38.521807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5c4c7-baf0-4b82-84fa-2556c669c737 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:38.528968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:38.528968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:38.528968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:38.529402 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:38.540724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:38.542446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:38.552488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1338/2659] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:38:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:38:40.384274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e927-f394-4288-b0e9-d23a3ddfd6bd None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:40.385189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e927-f394-4288-b0e9-d23a3ddfd6bd None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:40.385465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e927-f394-4288-b0e9-d23a3ddfd6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:40.434229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-9e15e927-f394-4288-b0e9-d23a3ddfd6bd None None] MFA Rules not processed for user `283e344437594357925fead9c0b2f498`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:40.436070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9e15e927-f394-4288-b0e9-d23a3ddfd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:40.557564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1322/2660] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:40.559706 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:40.572588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4768-8328-4852-840f-21fdc4d36845 service swift] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:40.591148 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:40.592089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:40.594414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:40.595055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:40.596391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:40.602630 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:40.777799 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1339/2661] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:40 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:40.779393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15e927-f394-4288-b0e9-d23a3ddfd6bd None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:40.795156 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15e927-f394-4288-b0e9-d23a3ddfd6bd None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:40.876084 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:40.877011 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:40.877513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:40.877789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:40.878445 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:40.880385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:40.996480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1323/2662] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:40 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:38:41.000034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:41.011044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04174caa-3491-4181-a9d7-2ff10bc8eece admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:41.017010 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:41.017916 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:41.022702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:41.022702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:41.022702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:41.022702 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:41.034198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1340/2663] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:41.038711 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:41.050207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ddec5-2205-427e-87ea-339fb3252db6 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:41.055648 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:41.056705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:41.056705 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:41.056949 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] PATH_INFO: `/v3/projects/497b401d4b014e9bb864d5cfacad456f/users/2802933c52cc40bb975efb32f5ed6d1a/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:41.076809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] RBAC: Authorizing `identity:create_grant(project_id=497b401d4b014e9bb864d5cfacad456f, user_id=2802933c52cc40bb975efb32f5ed6d1a, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:41.079722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:41.143535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1324/2664] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:41 2022] PUT /identity/v3/projects/497b401d4b014e9bb864d5cfacad456f/users/2802933c52cc40bb975efb32f5ed6d1a/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:38:41.147479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:41.158427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eae8c-8812-48a0-b462-31b5edb3aaa4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:41.223192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:41.223831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:41.224084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:41.224619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:41.225387 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:41.227440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:41.238998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1341/2665] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:41.243874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:41.254872 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbc17b-9b8c-4830-b816-8b2a66f9722f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:41.260094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:41.260928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:41.261295 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:41.261630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] PATH_INFO: `/v3/projects/497b401d4b014e9bb864d5cfacad456f/users/2802933c52cc40bb975efb32f5ed6d1a/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:41.263709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=497b401d4b014e9bb864d5cfacad456f, user_id=2802933c52cc40bb975efb32f5ed6d1a, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:41.266471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:41.278336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1325/2666] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:41 2022] PUT /identity/v3/projects/497b401d4b014e9bb864d5cfacad456f/users/2802933c52cc40bb975efb32f5ed6d1a/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:42.051991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:42.059178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:42.075592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea5b2c-6acd-408f-adb3-a3c3df56572a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:42.182261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:42.210499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:42.211155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:42.211586 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:42.211924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] PATH_INFO: `/v3/users/5039be557cac46fa917a062148d01abf` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:42.213168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5039be557cac46fa917a062148d01abf)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:42.217090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:42.474858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5039be557cac46fa917a062148d01abf'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:42.492460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5039be557cac46fa917a062148d01abf'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:42.493347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5039be557cac46fa917a062148d01abf'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:42.505353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5039be557cac46fa917a062148d01abf'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:42.608718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-e7ecc12f-9543-4198-9544-f5ba6d3e4a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5039be557cac46fa917a062148d01abf'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:42.616563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1342/2667] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:38:42 2022] DELETE /identity/v3/users/5039be557cac46fa917a062148d01abf => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:42.990491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:42.992480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:43.019183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da82a94-5bad-491f-80e7-487f51491bcb admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:43.049102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:43.105564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:43.106981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:43.106981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:43.106981 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] PATH_INFO: `/v3/projects/8d95718f20e6425fa968e6f8f23d14e4` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:43.108463 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d95718f20e6425fa968e6f8f23d14e4)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:43.110921 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:43.401857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d95718f20e6425fa968e6f8f23d14e4', 'request_id': 'req-10b33015-4c7f-4793-95c7-412ee8e9d86b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:43.409441 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d95718f20e6425fa968e6f8f23d14e4', 'request_id': 'req-10b33015-4c7f-4793-95c7-412ee8e9d86b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:43.420627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d95718f20e6425fa968e6f8f23d14e4', 'request_id': 'req-10b33015-4c7f-4793-95c7-412ee8e9d86b'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:43.545857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] The token cache is being invalidate because project 8d95718f20e6425fa968e6f8f23d14e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:38:43.546157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:43.546880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-10b33015-4c7f-4793-95c7-412ee8e9d86b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:38:43.552805 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1326/2668] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:38:42 2022] DELETE /identity/v3/projects/8d95718f20e6425fa968e6f8f23d14e4 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:43.555766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edbdad-209c-4358-842e-951addade101 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:43.556302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edbdad-209c-4358-842e-951addade101 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:43.556414 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edbdad-209c-4358-842e-951addade101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:43.579812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-27edbdad-209c-4358-842e-951addade101 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:43.580971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-27edbdad-209c-4358-842e-951addade101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:43.675382 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1343/2669] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:43.683786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402086-55c7-4d66-bee8-9bc1005b0bc8 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:43.684069 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402086-55c7-4d66-bee8-9bc1005b0bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:43.684391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402086-55c7-4d66-bee8-9bc1005b0bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:43.711764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-89402086-55c7-4d66-bee8-9bc1005b0bc8 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:43.713305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-89402086-55c7-4d66-bee8-9bc1005b0bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:43.727415 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1327/2670] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:43.728777 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edbdad-209c-4358-842e-951addade101 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:43.741098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edbdad-209c-4358-842e-951addade101 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:43.747643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:43.748653 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:43.749002 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:43.749575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:43.750304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:38:43.750682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:43.752413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:43.777528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1344/2671] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:38:43.779103 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402086-55c7-4d66-bee8-9bc1005b0bc8 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:43.791379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402086-55c7-4d66-bee8-9bc1005b0bc8 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:43.800014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:43.800772 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:43.801686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:43.802229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:43.804372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:43.809128 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:43.946720 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1328/2672] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:38:43 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:43.947619 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:43.958898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05d8b-9b70-47ad-a868-d0f815a80f1a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:44.014981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:44.024225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:44.024860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:44.025315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:44.025602 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:44.026871 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:44.028807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:44.135442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:44.143892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1345/2673] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:38:43 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:38:44.152969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56b0f-a1f7-40ad-b9a1-ad7c589f0d47 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:44.162937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:44.164161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:44.164827 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:44.165967 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:44.167132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:44.169073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:44.203204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:44.209833 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1329/2674] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:44.238491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c841ff5-4030-4034-85be-45610298219e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:44.248093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d915a-6a81-496a-8e72-0e644c0083a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:44.250187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d915a-6a81-496a-8e72-0e644c0083a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:44.250187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d915a-6a81-496a-8e72-0e644c0083a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:44.250187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d915a-6a81-496a-8e72-0e644c0083a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:44.250719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d915a-6a81-496a-8e72-0e644c0083a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:44.252689 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d915a-6a81-496a-8e72-0e644c0083a6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:44.275972 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1346/2675] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:38:44.282353 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:44.311888 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fefe7-a117-4ec5-95a0-fd05d997f48e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:44.318015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:44.318876 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:44.319308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:44.319955 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] PATH_INFO: `/v3/projects/5117bc3f94c84566b98c54a55d398c7a/users/332c4752029442059db75de963e1a77c/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:44.362916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5117bc3f94c84566b98c54a55d398c7a, user_id=332c4752029442059db75de963e1a77c, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:44.366134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:44.511598 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1330/2676] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:38:44 2022] PUT /identity/v3/projects/5117bc3f94c84566b98c54a55d398c7a/users/332c4752029442059db75de963e1a77c/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:38:44.522502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f619-73b7-4d34-a323-27cd50854ac3 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:44.523039 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f619-73b7-4d34-a323-27cd50854ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:44.523466 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f619-73b7-4d34-a323-27cd50854ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:44.563969 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2a66f619-73b7-4d34-a323-27cd50854ac3 None None] MFA Rules not processed for user `332c4752029442059db75de963e1a77c`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:44.565409 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2a66f619-73b7-4d34-a323-27cd50854ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:44.652052 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1347/2677] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:44.668697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:44.670770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:44.755940 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc4a9-c45e-4db4-a78f-e202d88c57d1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:44.761732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:44.762492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:44.762969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:44.763347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:44.771326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:44.774492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:44.776732 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:44.787690 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1331/2678] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:38:47.859636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fed22-917c-4593-97d2-8d21df7cbc01 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:47.860199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fed22-917c-4593-97d2-8d21df7cbc01 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:47.860199 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fed22-917c-4593-97d2-8d21df7cbc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:47.894270 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-175fed22-917c-4593-97d2-8d21df7cbc01 None None] MFA Rules not processed for user `2802933c52cc40bb975efb32f5ed6d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:47.899200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-175fed22-917c-4593-97d2-8d21df7cbc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:48.011993 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1348/2679] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:48.019592 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:48.021264 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:48.155082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b760569-5834-44f3-99db-c8f309edb143 service glance] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:48.162682 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:48.163307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:48.163587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:48.163867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:48.165900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:48.246729 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:48.248290 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:48.257733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1332/2680] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:51.354179 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:51.354776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:51.355752 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:51.379346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] MFA Rules not processed for user `283e344437594357925fead9c0b2f498`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:38:51.381230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:51.389196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1349/2681] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:38:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:38:55.091379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:38:55.094073 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:55.189406 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:55.209238 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48331-b979-407a-b6fc-1873c71b1abc service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:38:55.216862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:38:55.218044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:38:55.218604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:38:55.219150 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:38:55.221794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:38:55.236931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:38:55.239708 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:38:55.253587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1333/2682] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:38:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:00.269380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:00.270814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:00.322105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:00.334658 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05dad7-c26e-4c37-86cf-ecd9a0ca6fe5 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:00.338866 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:00.342582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:00.342582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:00.342582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:00.342582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:00.410080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:00.411629 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:00.424030 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1350/2683] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:04.583918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:04.585547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:04.602130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd7836-d899-42be-ae4a-bb15acfc0ee1 service placement] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:04.607728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:04.608391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:04.608671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:04.608954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] PATH_INFO: `/v3/users/3383f068af3f4509b781b77a6b56da7a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:04.610113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3383f068af3f4509b781b77a6b56da7a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:04.612161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:04.955244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3383f068af3f4509b781b77a6b56da7a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:04.969950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3383f068af3f4509b781b77a6b56da7a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:04.977983 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3383f068af3f4509b781b77a6b56da7a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.076372 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3383f068af3f4509b781b77a6b56da7a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.077159 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b58b7270-343a-4c11-bac3-ac00a39735ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3383f068af3f4509b781b77a6b56da7a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.085686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1334/2684] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:04 2022] DELETE /identity/v3/users/3383f068af3f4509b781b77a6b56da7a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:05.389398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:05.405328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e1edd-7071-4229-aaaa-e1d804c59f6b service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:05.481377 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:05.484149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:05.484149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:05.484149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] PATH_INFO: `/v3/projects/486c66a13fc54f97a47341b1c55167c2` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:05.484149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] RBAC: Authorizing `identity:delete_project(project_id=486c66a13fc54f97a47341b1c55167c2)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:05.488905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:05.635545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486c66a13fc54f97a47341b1c55167c2', 'request_id': 'req-af7359c7-c09f-43a6-b374-02fc9f76351b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.741206 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486c66a13fc54f97a47341b1c55167c2', 'request_id': 'req-af7359c7-c09f-43a6-b374-02fc9f76351b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.750471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486c66a13fc54f97a47341b1c55167c2', 'request_id': 'req-af7359c7-c09f-43a6-b374-02fc9f76351b'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.764023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] The token cache is being invalidate because project 486c66a13fc54f97a47341b1c55167c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:05.764313 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.764984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-af7359c7-c09f-43a6-b374-02fc9f76351b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:05.766552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1351/2685] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:05 2022] DELETE /identity/v3/projects/486c66a13fc54f97a47341b1c55167c2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:05.771602 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150d3f-e73d-4904-ac08-05d8f688354b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:05.772124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150d3f-e73d-4904-ac08-05d8f688354b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:05.772222 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150d3f-e73d-4904-ac08-05d8f688354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:05.795330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d9150d3f-e73d-4904-ac08-05d8f688354b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:05.796642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d9150d3f-e73d-4904-ac08-05d8f688354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:05.865846 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1335/2686] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:05.874867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a018-b804-44d1-b42c-118db70a629c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:05.875172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a018-b804-44d1-b42c-118db70a629c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:05.875472 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a018-b804-44d1-b42c-118db70a629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:05.896641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-fa33a018-b804-44d1-b42c-118db70a629c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:05.897805 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-fa33a018-b804-44d1-b42c-118db70a629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:05.906013 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1352/2687] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:05.910768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9150d3f-e73d-4904-ac08-05d8f688354b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:05.922696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9150d3f-e73d-4904-ac08-05d8f688354b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:05.927930 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:05.928548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:05.934360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:05.934360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:05.934360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:05.934360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:05.934360 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:05.944794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1336/2688] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:05.949309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a018-b804-44d1-b42c-118db70a629c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:05.958603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a018-b804-44d1-b42c-118db70a629c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:05.964272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:05.964982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:05.967663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:05.967663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:05.967663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:05.968152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:05.986214 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:06.097375 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1353/2689] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:05 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:06.102243 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:06.113185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac127f6f-247c-4f1b-9aed-4d2d1148f79b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:06.155040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:06.173251 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:06.173904 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:06.174206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:06.174503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:06.175200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:06.177198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:06.280556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1337/2690] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:06 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:06.285666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:06.300327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6794f66-7a2e-4194-b758-23ac6111bc72 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:06.309364 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:06.309994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:06.310322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:06.310664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:06.311487 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:06.313192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:06.331745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1354/2691] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:06.332388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:06.353712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df02b5-24f0-4846-b59f-0f3e91aaa2ab admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:06.358515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6b80-29c5-4b8c-afa9-19d2ce405dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:06.359125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6b80-29c5-4b8c-afa9-19d2ce405dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:06.359402 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6b80-29c5-4b8c-afa9-19d2ce405dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:06.359670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6b80-29c5-4b8c-afa9-19d2ce405dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:06.360310 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6b80-29c5-4b8c-afa9-19d2ce405dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:06.361958 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6b80-29c5-4b8c-afa9-19d2ce405dcf admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:06.374267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1338/2692] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:06.379831 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:06.394511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21161927-8cbe-4871-8b98-cd33dacd4ae3 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:06.401968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:06.403232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:06.403490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:06.403767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] PATH_INFO: `/v3/projects/c2aa64165a8343b69df80e2636232bc0/users/2c544a59207b4a20bd1f91a362ccf423/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:06.427774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2aa64165a8343b69df80e2636232bc0, user_id=2c544a59207b4a20bd1f91a362ccf423, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:06.427774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:06.555425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1355/2693] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:06 2022] PUT /identity/v3/projects/c2aa64165a8343b69df80e2636232bc0/users/2c544a59207b4a20bd1f91a362ccf423/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:06.584042 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ca678-15ec-4858-8538-b9fa7c3e1292 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:06.584250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ca678-15ec-4858-8538-b9fa7c3e1292 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:06.584525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ca678-15ec-4858-8538-b9fa7c3e1292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:06.622108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-cf0ca678-15ec-4858-8538-b9fa7c3e1292 None None] MFA Rules not processed for user `2c544a59207b4a20bd1f91a362ccf423`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:06.623333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-cf0ca678-15ec-4858-8538-b9fa7c3e1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:06.702412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1339/2694] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:06.702943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:06.783590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40956313-b79c-4a39-988a-5a1faa1e86e7 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:06.793329 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:06.794163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:06.794546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:06.794825 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:06.795574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:06.798171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:06.952852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1356/2695] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:06 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:06.957111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ca678-15ec-4858-8538-b9fa7c3e1292 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:06.968903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ca678-15ec-4858-8538-b9fa7c3e1292 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:07.028734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:07.029390 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.029667 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.029936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.030559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:07.032797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:07.194116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1340/2696] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:06 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:07.195358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:07.206561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d7668-7ebf-45ad-a448-2cd2975ad6dc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:07.211617 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:07.213386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.213386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.213386 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.214248 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:07.215919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:07.228779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1357/2697] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:07.233281 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:07.243797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774796a7-86fc-44be-89e4-9a1037108d8a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:07.248727 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fe83b-255e-4bf6-a3fc-7fef7ed4aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:07.253267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fe83b-255e-4bf6-a3fc-7fef7ed4aae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.253267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fe83b-255e-4bf6-a3fc-7fef7ed4aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.253267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fe83b-255e-4bf6-a3fc-7fef7ed4aae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.253267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fe83b-255e-4bf6-a3fc-7fef7ed4aae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:07.253267 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fe83b-255e-4bf6-a3fc-7fef7ed4aae9 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:07.263301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1341/2698] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:07.267812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:07.286983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3a50b-623e-4f37-a531-4584b447144e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:07.292401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:07.293108 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.293379 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.293675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] PATH_INFO: `/v3/projects/60c129bac3484851b68521b5539c7fe3/users/201b7b084faa44daa17046e0a3a86e68/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.308814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c129bac3484851b68521b5539c7fe3, user_id=201b7b084faa44daa17046e0a3a86e68, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:07.311544 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:07.397915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1358/2699] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:07 2022] PUT /identity/v3/projects/60c129bac3484851b68521b5539c7fe3/users/201b7b084faa44daa17046e0a3a86e68/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:07.409260 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2f79-287d-4427-859f-4fc88bc36508 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.409719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2f79-287d-4427-859f-4fc88bc36508 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.410055 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2f79-287d-4427-859f-4fc88bc36508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.443858 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-fd9b2f79-287d-4427-859f-4fc88bc36508 None None] MFA Rules not processed for user `201b7b084faa44daa17046e0a3a86e68`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:07.445111 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fd9b2f79-287d-4427-859f-4fc88bc36508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:07.463609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:07.520195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1342/2700] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:07.525865 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:07.594958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b90f6-7e41-455b-957a-89fba3365672 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:07.600688 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:07.601338 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.601624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.601895 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.602537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:07.604623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:07.620237 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:07.735391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1359/2701] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:07 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:39:07.739664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b2f79-287d-4427-859f-4fc88bc36508 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:07.750907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b2f79-287d-4427-859f-4fc88bc36508 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:07.810714 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:07.811374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.811655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.811927 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.813509 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:07.815521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:07.961692 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1343/2702] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:07 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:07.966791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:07.977906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e61a2-1c28-4fc0-bce5-8c47c99d0e08 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:07.982519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:07.983204 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:07.983477 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:07.983745 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:07.984393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:07.986435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:07.999130 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1360/2703] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:08.003396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:08.014245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18cff-c00e-4442-b346-0e222226e47f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:08.018815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:08.019459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:08.019761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:08.020016 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] PATH_INFO: `/v3/projects/afe630186bea4dfea333c24d51614161/users/f64e237825ed45759c19ea66d49244f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:08.034661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe630186bea4dfea333c24d51614161, user_id=f64e237825ed45759c19ea66d49244f6, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:08.037392 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:08.119730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1344/2704] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:08 2022] PUT /identity/v3/projects/afe630186bea4dfea333c24d51614161/users/f64e237825ed45759c19ea66d49244f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:08.123867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:08.133978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdff2-e3c7-43a8-876f-a1683a979444 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:08.193852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e70c9f-80be-417e-be9d-ab79e9e1b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:08.194464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70c9f-80be-417e-be9d-ab79e9e1b3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:08.194746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70c9f-80be-417e-be9d-ab79e9e1b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:08.195019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70c9f-80be-417e-be9d-ab79e9e1b3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:08.195672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e70c9f-80be-417e-be9d-ab79e9e1b3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:08.197353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e70c9f-80be-417e-be9d-ab79e9e1b3fd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:08.207245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1361/2705] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:08.211826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:08.222396 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502fe8e-6e08-48a4-b87a-fcd77e301f3b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:08.227378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:08.228697 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:08.234859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:08.234859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] PATH_INFO: `/v3/projects/afe630186bea4dfea333c24d51614161/users/f64e237825ed45759c19ea66d49244f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:08.234859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe630186bea4dfea333c24d51614161, user_id=f64e237825ed45759c19ea66d49244f6, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:08.234859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:08.250429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1345/2706] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:08 2022] PUT /identity/v3/projects/afe630186bea4dfea333c24d51614161/users/f64e237825ed45759c19ea66d49244f6/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:08.261144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016bfa-28c1-4454-a0d1-b7930d7cce67 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:08.261548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016bfa-28c1-4454-a0d1-b7930d7cce67 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:08.261677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016bfa-28c1-4454-a0d1-b7930d7cce67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:08.293000 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-5b016bfa-28c1-4454-a0d1-b7930d7cce67 None None] MFA Rules not processed for user `f64e237825ed45759c19ea66d49244f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:08.294298 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5b016bfa-28c1-4454-a0d1-b7930d7cce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:08.386244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1362/2707] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:08.397422 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:08.399186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:08.469531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974e1da-bb95-4768-bb9e-59295e44f16f admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:08.473472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:08.474366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:08.474641 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:08.474907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:08.485999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:08.488671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:08.497970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1346/2708] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:09.745640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b016bfa-28c1-4454-a0d1-b7930d7cce67 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:09.755309 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b016bfa-28c1-4454-a0d1-b7930d7cce67 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:09.758955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0170d-c1a1-4aab-bc89-e9e34009f16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:09.759802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0170d-c1a1-4aab-bc89-e9e34009f16e service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:09.759802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0170d-c1a1-4aab-bc89-e9e34009f16e service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:09.760085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0170d-c1a1-4aab-bc89-e9e34009f16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:09.825557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0170d-c1a1-4aab-bc89-e9e34009f16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:09.832821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0170d-c1a1-4aab-bc89-e9e34009f16e service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:09.844977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1363/2709] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:16.203244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:16.204762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:16.216699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8364a38-de1b-4d39-a58a-5f673ed1f535 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:16.220844 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:16.221536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:16.221783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:16.222148 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:16.233565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:16.297005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:16.299585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:16.313401 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1347/2710] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:19.069919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30744-8b5d-4b06-a087-be2422df732e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:19.071449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30744-8b5d-4b06-a087-be2422df732e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:19.071449 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30744-8b5d-4b06-a087-be2422df732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:19.079742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:19.093213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6ad30744-8b5d-4b06-a087-be2422df732e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:19.094450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6ad30744-8b5d-4b06-a087-be2422df732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:19.173598 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1364/2711] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:19.200120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:19.201566 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:19.302627 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c3f24-5fb5-45e7-99c6-a25a8ad6977f service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:19.310595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16e046-1e65-4f20-bc40-864b6e98f17b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:19.311257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e046-1e65-4f20-bc40-864b6e98f17b service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:19.311533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e046-1e65-4f20-bc40-864b6e98f17b service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:19.311802 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e046-1e65-4f20-bc40-864b6e98f17b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:19.325253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16e046-1e65-4f20-bc40-864b6e98f17b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:19.325253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16e046-1e65-4f20-bc40-864b6e98f17b service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:19.337206 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1348/2712] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:21.602102 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30744-8b5d-4b06-a087-be2422df732e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:21.614302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30744-8b5d-4b06-a087-be2422df732e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:21.619885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:21.630574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:21.630574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:21.630574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] PATH_INFO: `/v3/users/2c544a59207b4a20bd1f91a362ccf423` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:21.630574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c544a59207b4a20bd1f91a362ccf423)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:21.630574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:21.905281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c544a59207b4a20bd1f91a362ccf423'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:21.919914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c544a59207b4a20bd1f91a362ccf423'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:21.920567 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c544a59207b4a20bd1f91a362ccf423'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:21.928165 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c544a59207b4a20bd1f91a362ccf423'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:22.020122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c544a59207b4a20bd1f91a362ccf423'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:22.027908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1365/2713] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:21 2022] DELETE /identity/v3/users/2c544a59207b4a20bd1f91a362ccf423 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:22.032985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:22.033787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:22.033787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:22.054923 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:22.056240 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:22.060325 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:22.062437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:22.149047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1349/2714] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:22.157452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85ddb-b816-41d7-bd91-4275bec5815e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:22.159349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:22.160814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:22.162388 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:22.163024 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:22.163331 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:22.163599 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] PATH_INFO: `/v3/users/332c4752029442059db75de963e1a77c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:22.164815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332c4752029442059db75de963e1a77c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:22.166749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:22.186393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:22.211556 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:22.225944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6845b3-e98a-4ca1-b035-94801a507df0 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:22.229782 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df0a37-7e29-4a92-b81a-9e6cd644f764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:22.230413 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df0a37-7e29-4a92-b81a-9e6cd644f764 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:22.230753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df0a37-7e29-4a92-b81a-9e6cd644f764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:22.231034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df0a37-7e29-4a92-b81a-9e6cd644f764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:22.243062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df0a37-7e29-4a92-b81a-9e6cd644f764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:22.245347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df0a37-7e29-4a92-b81a-9e6cd644f764 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:22.255837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1350/2715] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:22.426880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332c4752029442059db75de963e1a77c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:22.439154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332c4752029442059db75de963e1a77c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:22.439861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332c4752029442059db75de963e1a77c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:22.450172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332c4752029442059db75de963e1a77c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:22.531663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332c4752029442059db75de963e1a77c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:22.542555 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1366/2716] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:22 2022] DELETE /identity/v3/users/332c4752029442059db75de963e1a77c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:22.550646 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:22.550960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:22.551429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:22.578700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:22.579847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:22.712420 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1351/2717] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:22.721137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:22.722907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:22.817108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:22.817108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:22.817318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579590aa-c138-4b0f-8eb7-1bb185fb2ed2 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:22.819304 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:22.819938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:22.820215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:22.820669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:22.829658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ba02-60c0-4114-b21b-90970477011e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:22.837446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:22.838423 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:22.839272 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:22.839796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] PATH_INFO: `/v3/projects/c2aa64165a8343b69df80e2636232bc0` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:22.842304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2aa64165a8343b69df80e2636232bc0)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:22.847186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:22.861566 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:22.864592 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:22.896050 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1367/2718] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:23.078179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2aa64165a8343b69df80e2636232bc0', 'request_id': 'req-7184aecc-4164-4ec0-a7b1-7423429897d8'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.084800 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2aa64165a8343b69df80e2636232bc0', 'request_id': 'req-7184aecc-4164-4ec0-a7b1-7423429897d8'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.092446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2aa64165a8343b69df80e2636232bc0', 'request_id': 'req-7184aecc-4164-4ec0-a7b1-7423429897d8'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.191014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] The token cache is being invalidate because project c2aa64165a8343b69df80e2636232bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:23.191330 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.192007 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.193757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1352/2719] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:22 2022] DELETE /identity/v3/projects/c2aa64165a8343b69df80e2636232bc0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:23.198496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:23.210228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d77f9-3a59-464e-a0ee-fd491e314048 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:23.293042 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:23.293879 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:23.294159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:23.294437 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] PATH_INFO: `/v3/users/201b7b084faa44daa17046e0a3a86e68` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:23.295783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] RBAC: Authorizing `identity:delete_user(user_id=201b7b084faa44daa17046e0a3a86e68)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:23.297858 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:23.421255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:23.423203 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:23.441900 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184aecc-4164-4ec0-a7b1-7423429897d8 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:23.447424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:23.448108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:23.448417 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:23.448677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] PATH_INFO: `/v3/projects/5117bc3f94c84566b98c54a55d398c7a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:23.449954 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5117bc3f94c84566b98c54a55d398c7a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:23.452755 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:23.520100 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:23.530070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201b7b084faa44daa17046e0a3a86e68'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.543175 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201b7b084faa44daa17046e0a3a86e68'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.543945 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201b7b084faa44daa17046e0a3a86e68'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.552667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201b7b084faa44daa17046e0a3a86e68'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.624446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5117bc3f94c84566b98c54a55d398c7a', 'request_id': 'req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.632350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5117bc3f94c84566b98c54a55d398c7a', 'request_id': 'req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.634756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:23.642966 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5117bc3f94c84566b98c54a55d398c7a', 'request_id': 'req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.678119 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-863bef10-de9f-4fcd-8b3d-5d763b7a165a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201b7b084faa44daa17046e0a3a86e68'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.689850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1368/2720] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:23 2022] DELETE /identity/v3/users/201b7b084faa44daa17046e0a3a86e68 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:23.692033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2aa8-3d39-4814-bb42-86f9ca7d145e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:23.692638 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2aa8-3d39-4814-bb42-86f9ca7d145e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:23.693192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2aa8-3d39-4814-bb42-86f9ca7d145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:23.731191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-24ac2aa8-3d39-4814-bb42-86f9ca7d145e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:23.733438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-24ac2aa8-3d39-4814-bb42-86f9ca7d145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:23.788675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] The token cache is being invalidate because project 5117bc3f94c84566b98c54a55d398c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:23.789095 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.790830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2e668ec7-f741-4f5b-a998-1bdc7133b0a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:23.793665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1353/2721] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:23 2022] DELETE /identity/v3/projects/5117bc3f94c84566b98c54a55d398c7a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:23.801515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:23.801993 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:23.802476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:23.832141 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:23.833412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:23.834067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1369/2722] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:23.842696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1354/2723] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:23.852552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea636aa-d7d4-4631-96b5-1850a1b8a804 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:23.852552 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea636aa-d7d4-4631-96b5-1850a1b8a804 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:23.852956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea636aa-d7d4-4631-96b5-1850a1b8a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:23.862253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:23.865020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:23.878928 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-aea636aa-d7d4-4631-96b5-1850a1b8a804 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:23.880675 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-aea636aa-d7d4-4631-96b5-1850a1b8a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:23.891989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1370/2724] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:23.897548 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea636aa-d7d4-4631-96b5-1850a1b8a804 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:23.913098 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea636aa-d7d4-4631-96b5-1850a1b8a804 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:23.922059 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:23.923188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:23.923681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:23.924238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:23.925551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:23.926107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:23.929164 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:23.953163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1371/2725] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:39:23.958640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:23.972227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b067b-bc98-477c-b08a-073c5b2c3148 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:23.981735 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:23.982811 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:23.983419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:23.983952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:23.987607 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:23.998158 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.005749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd931-bd58-4448-a093-47a6cb35220b None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.022768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.024061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.024764 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.025364 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.047819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.047819 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.063880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1355/2726] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:24.126911 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1372/2727] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:39:24.132371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:24.156171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7b83-0fee-4a1b-99f6-018eff32dff2 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.234777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.235642 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.236142 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.236484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.237342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.239588 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.247812 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:24.251200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:24.277252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763231d-43f3-450d-bb53-e32159a0d146 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.284864 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.285731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.286101 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.286435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] PATH_INFO: `/v3/projects/60c129bac3484851b68521b5539c7fe3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.287826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c129bac3484851b68521b5539c7fe3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.290845 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.348871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1356/2728] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:24 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:24.354145 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:24.364882 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f762704-b452-4a4d-a0db-b5528a72f268 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.373096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.373914 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.374293 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.374675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.375438 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.377465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.390841 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1357/2729] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:24.395019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:24.408666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb594f4-a34e-4270-865a-8edc2ff90973 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.426769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c129bac3484851b68521b5539c7fe3', 'request_id': 'req-66b0393e-2125-4df1-9aeb-17d10b40a57f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.467505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:24.486543 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.487325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.487504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.487777 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.488444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.490091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.501789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1358/2730] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:24.503908 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c129bac3484851b68521b5539c7fe3', 'request_id': 'req-66b0393e-2125-4df1-9aeb-17d10b40a57f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.506668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:24.510791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c129bac3484851b68521b5539c7fe3', 'request_id': 'req-66b0393e-2125-4df1-9aeb-17d10b40a57f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.517536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886aab2-8aaf-4ffc-8789-e9a6f7fc93bd admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.518773 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:24.522329 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dde450-7aa4-4f86-871d-843db6dce1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.522986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dde450-7aa4-4f86-871d-843db6dce1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.523269 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dde450-7aa4-4f86-871d-843db6dce1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.523479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] The token cache is being invalidate because project 60c129bac3484851b68521b5539c7fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:24.524079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dde450-7aa4-4f86-871d-843db6dce1f6 admin admin] PATH_INFO: `/v3/projects/3eff9d62a0a7491eb74d5cfbe5cb8d99/users/afff173b52094c2ca206bdbe0bc56fd0/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.524288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.524971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.526525 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1373/2731] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:24 2022] DELETE /identity/v3/projects/60c129bac3484851b68521b5539c7fe3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:24.530696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:24.532043 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:24.541615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dde450-7aa4-4f86-871d-843db6dce1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eff9d62a0a7491eb74d5cfbe5cb8d99, user_id=afff173b52094c2ca206bdbe0bc56fd0, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.544300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dde450-7aa4-4f86-871d-843db6dce1f6 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.546452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0393e-2125-4df1-9aeb-17d10b40a57f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.552423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.553080 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.553376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.553714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] PATH_INFO: `/v3/users/f64e237825ed45759c19ea66d49244f6` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.554937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64e237825ed45759c19ea66d49244f6)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.556941 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.666937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1359/2732] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:24 2022] PUT /identity/v3/projects/3eff9d62a0a7491eb74d5cfbe5cb8d99/users/afff173b52094c2ca206bdbe0bc56fd0/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:24.691040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.691384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.691694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.726519 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] MFA Rules not processed for user `afff173b52094c2ca206bdbe0bc56fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:24.728421 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:24.821346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1360/2733] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:24.833924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:24.835263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:24.891438 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64e237825ed45759c19ea66d49244f6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.906230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64e237825ed45759c19ea66d49244f6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.907093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64e237825ed45759c19ea66d49244f6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.915363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64e237825ed45759c19ea66d49244f6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:24.929516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b95c-a0e7-4b65-b88c-2f87d8197e64 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:24.935871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:24.936508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:24.936887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:24.937209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:24.939066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:24.953612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:24.955116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:24.965622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1361/2734] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:25.032639 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-68fc6d30-fb1b-4a35-9bd1-63008e83c7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64e237825ed45759c19ea66d49244f6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:25.041169 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1374/2735] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:24 2022] DELETE /identity/v3/users/f64e237825ed45759c19ea66d49244f6 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:25.627640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:25.629561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:25.694061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:25.722318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821691cb-5008-4b25-976d-7d0cf35c35e3 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:25.828175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:25.828435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:25.828988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:25.829579 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] PATH_INFO: `/v3/projects/afe630186bea4dfea333c24d51614161` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:25.834845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe630186bea4dfea333c24d51614161)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:25.837775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:26.064019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe630186bea4dfea333c24d51614161', 'request_id': 'req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:26.071435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe630186bea4dfea333c24d51614161', 'request_id': 'req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:26.077953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe630186bea4dfea333c24d51614161', 'request_id': 'req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:26.169661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] The token cache is being invalidate because project afe630186bea4dfea333c24d51614161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:26.169661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:26.170234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9d47ce8d-94f3-4124-8677-4d3b3d3c5f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:26.172194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1362/2736] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:25 2022] DELETE /identity/v3/projects/afe630186bea4dfea333c24d51614161 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:26.180082 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b2712-a204-4e65-81a5-3b0ef49afc10 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.180846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b2712-a204-4e65-81a5-3b0ef49afc10 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.181453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b2712-a204-4e65-81a5-3b0ef49afc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.217559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b13b2712-a204-4e65-81a5-3b0ef49afc10 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:26.219776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b13b2712-a204-4e65-81a5-3b0ef49afc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:26.310422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1375/2737] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:26.320271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a09c7-49b7-4cc8-b9d7-7943af339017 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.321209 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a09c7-49b7-4cc8-b9d7-7943af339017 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.321694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a09c7-49b7-4cc8-b9d7-7943af339017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.344305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-f59a09c7-49b7-4cc8-b9d7-7943af339017 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:26.345609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f59a09c7-49b7-4cc8-b9d7-7943af339017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:26.356271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1363/2738] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:26.367661 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b2712-a204-4e65-81a5-3b0ef49afc10 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:26.384938 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b2712-a204-4e65-81a5-3b0ef49afc10 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:26.392173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:26.392880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.393192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.393490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.394139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:26.394447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:26.396071 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:26.416834 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1376/2739] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:26.418877 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a09c7-49b7-4cc8-b9d7-7943af339017 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:26.428893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a09c7-49b7-4cc8-b9d7-7943af339017 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:26.436896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:26.437567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.437849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.438124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.438765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:26.440722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:26.544307 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1364/2740] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:26 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:26.549128 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:26.560827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf92de-ea7a-4c56-a65e-130b07cbd30a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:26.623881 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:26.631378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:26.632007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.632259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.632677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.633910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:26.635906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:26.806076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1377/2741] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:26 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:26.810796 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:26.822801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8ff8-ea3d-4ce8-9128-a194b87048f1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:26.828386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:26.829175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.829605 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.832699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.832699 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:26.833460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:26.848830 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1365/2742] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:26.858742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:26.870946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceccd07-744f-48ce-9695-3ee5a45cfc6a admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:26.876625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca54003-57e2-4d18-8983-16e2a7bb3355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:26.877300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54003-57e2-4d18-8983-16e2a7bb3355 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.877576 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54003-57e2-4d18-8983-16e2a7bb3355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.877850 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54003-57e2-4d18-8983-16e2a7bb3355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.878663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca54003-57e2-4d18-8983-16e2a7bb3355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:26.880435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca54003-57e2-4d18-8983-16e2a7bb3355 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:26.905053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1378/2743] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:26.906459 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:26.928486 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2666ae1-b84d-43da-9e85-d37b8b7cba1a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:26.934583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:26.935278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:26.935743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:26.936165 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] PATH_INFO: `/v3/projects/3c93ac44d3854ae198367c19e5b76c60/users/c4733b99da814b148aa8d48e96557e97/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:26.958236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c93ac44d3854ae198367c19e5b76c60, user_id=c4733b99da814b148aa8d48e96557e97, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:26.961867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:27.053523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1366/2744] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:26 2022] PUT /identity/v3/projects/3c93ac44d3854ae198367c19e5b76c60/users/c4733b99da814b148aa8d48e96557e97/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:27.066683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f375a-c7c1-468f-9d14-772a007f656c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:27.067761 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f375a-c7c1-468f-9d14-772a007f656c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:27.068663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f375a-c7c1-468f-9d14-772a007f656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:27.124875 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-233f375a-c7c1-468f-9d14-772a007f656c None None] MFA Rules not processed for user `c4733b99da814b148aa8d48e96557e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:27.127332 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-233f375a-c7c1-468f-9d14-772a007f656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:27.248994 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1379/2745] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:27.255440 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:27.311057 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:27.386000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c3126-3de2-4d9b-83b4-ad720d7c0978 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:27.392302 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:27.392689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:27.392971 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:27.393274 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:27.393960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:27.404482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:27.515380 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1367/2746] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:27 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:27.520105 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f375a-c7c1-468f-9d14-772a007f656c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:27.533601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f375a-c7c1-468f-9d14-772a007f656c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:27.640335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:27.641288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:27.641699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:27.642114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:27.642851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:27.644914 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:27.760441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1380/2747] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:27 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:39:27.766171 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:27.778541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a2b2-c8ef-42e0-9a59-63c38f3801c4 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:27.783994 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:27.787082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:27.787082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:27.787082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:27.787082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:27.787787 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:27.816328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1368/2748] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:27.819322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:27.840261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e019049-ce44-4f71-bce3-f0064d1d85bc admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:27.849468 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b2a2-d978-47e1-b89a-2cdba7d6fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:27.850588 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b2a2-d978-47e1-b89a-2cdba7d6fe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:27.851067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b2a2-d978-47e1-b89a-2cdba7d6fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:27.851556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b2a2-d978-47e1-b89a-2cdba7d6fe5e admin admin] PATH_INFO: `/v3/projects/9b73e4126bd147dbbb94d34a3281d923/users/84fdf865c7a34fb18aa8d5ce33108d2f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:27.879832 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b2a2-d978-47e1-b89a-2cdba7d6fe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b73e4126bd147dbbb94d34a3281d923, user_id=84fdf865c7a34fb18aa8d5ce33108d2f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:27.885703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b2a2-d978-47e1-b89a-2cdba7d6fe5e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:28.075423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1381/2749] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:27 2022] PUT /identity/v3/projects/9b73e4126bd147dbbb94d34a3281d923/users/84fdf865c7a34fb18aa8d5ce33108d2f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:28.079766 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:28.097157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f256a80-9cd7-41a5-8fc0-38c1ec958a2a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:28.159944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:28.160378 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:28.160761 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:28.177881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:28.178880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:28.179164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:28.179442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:28.180614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:28.182344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:28.186090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:28.187327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:28.196465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1369/2750] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:28.196848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1382/2751] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:28.200625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:28.212047 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6429803-282f-4e58-bafb-c207721c36e1 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:28.218929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8479b3-a082-47f1-87bd-f830bb9b6fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:28.223759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8479b3-a082-47f1-87bd-f830bb9b6fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:28.223759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8479b3-a082-47f1-87bd-f830bb9b6fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:28.223759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8479b3-a082-47f1-87bd-f830bb9b6fc8 admin admin] PATH_INFO: `/v3/projects/9b73e4126bd147dbbb94d34a3281d923/users/84fdf865c7a34fb18aa8d5ce33108d2f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:28.224121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:28.224305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8479b3-a082-47f1-87bd-f830bb9b6fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b73e4126bd147dbbb94d34a3281d923, user_id=84fdf865c7a34fb18aa8d5ce33108d2f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:28.225466 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8479b3-a082-47f1-87bd-f830bb9b6fc8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:28.228564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:28.245867 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1370/2752] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:28 2022] PUT /identity/v3/projects/9b73e4126bd147dbbb94d34a3281d923/users/84fdf865c7a34fb18aa8d5ce33108d2f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:28.250247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:28.250528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:28.250803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:28.295540 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] MFA Rules not processed for user `84fdf865c7a34fb18aa8d5ce33108d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:28.295853 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:28.297314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:28.365215 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c03f-7f4a-45bf-a71c-741c8e5ef7d7 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:28.436250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1371/2753] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:28.450298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:28.455762 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:28.458672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:28.472346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc5fa2-6b8c-4db9-b282-de9286eb951c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:28.473006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc5fa2-6b8c-4db9-b282-de9286eb951c service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:28.473328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc5fa2-6b8c-4db9-b282-de9286eb951c service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:28.473852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc5fa2-6b8c-4db9-b282-de9286eb951c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:28.532002 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832b79-d085-418b-8c47-b96b30264153 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:28.538929 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:28.539735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:28.560959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:28.560959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:28.560959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:28.560959 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:28.566397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1372/2754] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:28.569144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc5fa2-6b8c-4db9-b282-de9286eb951c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:28.571605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc5fa2-6b8c-4db9-b282-de9286eb951c service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:28.588259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1383/2755] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:28.982191 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:28.983985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:28.997337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218d9e5-17e7-4657-9e21-02e4dc83834a service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:29.002868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:29.003490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:29.003775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:29.004044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:29.076040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:29.077631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:29.087909 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1373/2756] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:32.212651 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68425-3956-4c6e-b07b-062c8aab64df None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:32.213230 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68425-3956-4c6e-b07b-062c8aab64df None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:32.213330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68425-3956-4c6e-b07b-062c8aab64df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:32.246712 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-8ca68425-3956-4c6e-b07b-062c8aab64df None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:32.248170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8ca68425-3956-4c6e-b07b-062c8aab64df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:32.257171 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1384/2757] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:32.280885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:32.300397 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963430-a46e-47c3-a8ab-7fa815c5c783 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:32.309803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:32.310437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:32.310722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:32.311006 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:32.330617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:32.331140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:32.345734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1374/2758] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:36.806186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aece1f-18a7-4269-ae59-e20c7873e682 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.807225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aece1f-18a7-4269-ae59-e20c7873e682 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.807225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aece1f-18a7-4269-ae59-e20c7873e682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.862061 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b0aece1f-18a7-4269-ae59-e20c7873e682 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.865454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b0aece1f-18a7-4269-ae59-e20c7873e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.885443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1385/2759] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.913808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.928915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.949037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d78630-3730-4d62-8e3b-269905f16178 service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.961395 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d9f62-1a4c-4d27-a388-6c27fec5b165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.962898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d9f62-1a4c-4d27-a388-6c27fec5b165 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.963652 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d9f62-1a4c-4d27-a388-6c27fec5b165 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.964483 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d9f62-1a4c-4d27-a388-6c27fec5b165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.985116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d9f62-1a4c-4d27-a388-6c27fec5b165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.985116 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d9f62-1a4c-4d27-a388-6c27fec5b165 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.995590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1375/2760] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:38.270539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aece1f-18a7-4269-ae59-e20c7873e682 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.283389 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aece1f-18a7-4269-ae59-e20c7873e682 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.288195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.290218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.290218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.290408 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] PATH_INFO: `/v3/users/c4733b99da814b148aa8d48e96557e97` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.299560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4733b99da814b148aa8d48e96557e97)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.299560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.609452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:38.620144 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4733b99da814b148aa8d48e96557e97'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:38.635222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4733b99da814b148aa8d48e96557e97'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:38.638436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4733b99da814b148aa8d48e96557e97'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:38.643827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4733b99da814b148aa8d48e96557e97'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:38.812762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4733b99da814b148aa8d48e96557e97'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:38.820454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1386/2761] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:38 2022] DELETE /identity/v3/users/c4733b99da814b148aa8d48e96557e97 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:38.825377 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.827671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.827671 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.848915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:38.852053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:38.941344 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1376/2762] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:38.955044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.956461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:39.020081 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869337e-43e9-4ddb-9197-675784df1367 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.024453 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.026765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.026765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.026765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.035989 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.037479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.048257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1387/2763] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:39.522320 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.524918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:39.542145 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1437c1a-be0b-446e-8824-f6a20492cf6f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.547081 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.547589 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.547868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.548145 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] PATH_INFO: `/v3/users/afff173b52094c2ca206bdbe0bc56fd0` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.549355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afff173b52094c2ca206bdbe0bc56fd0)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.551280 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.566674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:39.605549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.607161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:39.629537 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae94208-bba9-4a25-8c5d-384c85bab9ef service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.636264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.636964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.637172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.637574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] PATH_INFO: `/v3/projects/3c93ac44d3854ae198367c19e5b76c60` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.638625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c93ac44d3854ae198367c19e5b76c60)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.640570 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.866676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afff173b52094c2ca206bdbe0bc56fd0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.867580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c93ac44d3854ae198367c19e5b76c60', 'request_id': 'req-5f1f7970-9d16-45c7-a6f1-ab6619089489'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.885216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afff173b52094c2ca206bdbe0bc56fd0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.893625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afff173b52094c2ca206bdbe0bc56fd0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.950751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c93ac44d3854ae198367c19e5b76c60', 'request_id': 'req-5f1f7970-9d16-45c7-a6f1-ab6619089489'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.958396 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c93ac44d3854ae198367c19e5b76c60', 'request_id': 'req-5f1f7970-9d16-45c7-a6f1-ab6619089489'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.970740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] The token cache is being invalidate because project 3c93ac44d3854ae198367c19e5b76c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:39.971017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.971684 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:39.973633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1388/2764] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:39 2022] DELETE /identity/v3/projects/3c93ac44d3854ae198367c19e5b76c60 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:39.977667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.982815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.039010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afff173b52094c2ca206bdbe0bc56fd0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:40.040132 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-3e36b88e-031b-4d85-ad5d-0e0cc5396371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afff173b52094c2ca206bdbe0bc56fd0'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:40.045137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:40.053261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1377/2765] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:39 2022] DELETE /identity/v3/users/afff173b52094c2ca206bdbe0bc56fd0 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:40.060382 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f9473-a1b2-4926-adf6-a9648bc3d016 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.064186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f9473-a1b2-4926-adf6-a9648bc3d016 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.064186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f9473-a1b2-4926-adf6-a9648bc3d016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.096726 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7970-9d16-45c7-a6f1-ab6619089489 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:40.120696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-5a0f9473-a1b2-4926-adf6-a9648bc3d016 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:40.120696 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5a0f9473-a1b2-4926-adf6-a9648bc3d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.199261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:40.199984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.200261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.200533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] PATH_INFO: `/v3/users/84fdf865c7a34fb18aa8d5ce33108d2f` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.202007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84fdf865c7a34fb18aa8d5ce33108d2f)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:40.204020 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:40.234512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1378/2766] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:40.234933 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.235531 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.235907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.262374 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:40.264085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.275717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1379/2767] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:40.276763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:40.278300 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.349021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eada7e-7d18-4cf0-b2df-29d0641d9e3c None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:40.354113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:40.354743 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.355027 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.355444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.366472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:40.367985 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:40.378549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1380/2768] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:40.381394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:40.381394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.421271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:40.447665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84fdf865c7a34fb18aa8d5ce33108d2f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:40.466251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84fdf865c7a34fb18aa8d5ce33108d2f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:40.467064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84fdf865c7a34fb18aa8d5ce33108d2f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:40.476961 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84fdf865c7a34fb18aa8d5ce33108d2f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:40.477227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525bc1a-97d8-42c8-9ffc-1ddfc1aee211 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:40.484388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:40.485127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.485505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.485956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.491318 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.507541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:40.509202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:40.526829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1381/2769] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:40.604007 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84fdf865c7a34fb18aa8d5ce33108d2f'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:40.611862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1389/2770] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:39 2022] DELETE /identity/v3/users/84fdf865c7a34fb18aa8d5ce33108d2f => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:40.953931 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:40.955470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.979611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ef79-dfdc-408f-9a5a-ecc87cbaef6a service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.047404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.048085 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.048368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.048644 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] PATH_INFO: `/v3/projects/3eff9d62a0a7491eb74d5cfbe5cb8d99` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.049883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eff9d62a0a7491eb74d5cfbe5cb8d99)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.051842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.210521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eff9d62a0a7491eb74d5cfbe5cb8d99', 'request_id': 'req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.215895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eff9d62a0a7491eb74d5cfbe5cb8d99', 'request_id': 'req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.222407 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eff9d62a0a7491eb74d5cfbe5cb8d99', 'request_id': 'req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.227898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.229837 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.246189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daed30-7dc9-4d22-ae0d-bf58fc40f3b7 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.309718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.310681 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.310958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.311232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] PATH_INFO: `/v3/projects/9b73e4126bd147dbbb94d34a3281d923` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.312435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b73e4126bd147dbbb94d34a3281d923)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.314765 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.332652 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:41.367170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] The token cache is being invalidate because project 3eff9d62a0a7491eb74d5cfbe5cb8d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:41.367918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.368162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-bf3a6337-8477-4d6c-8cfe-aeeb643cfca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.369693 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1382/2771] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:40 2022] DELETE /identity/v3/projects/3eff9d62a0a7491eb74d5cfbe5cb8d99 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:41.375013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634591d1-9d18-4d3c-a13a-a950287dac1f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.376157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634591d1-9d18-4d3c-a13a-a950287dac1f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.376157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634591d1-9d18-4d3c-a13a-a950287dac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.398381 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-634591d1-9d18-4d3c-a13a-a950287dac1f None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:41.399960 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-634591d1-9d18-4d3c-a13a-a950287dac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.408734 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1383/2772] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:41.416278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a639a-efc2-4122-92f1-e7f942698d48 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.416555 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a639a-efc2-4122-92f1-e7f942698d48 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.416835 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a639a-efc2-4122-92f1-e7f942698d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.436896 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2e7a639a-efc2-4122-92f1-e7f942698d48 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:41.438133 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2e7a639a-efc2-4122-92f1-e7f942698d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.449448 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1384/2773] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:41.453829 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a639a-efc2-4122-92f1-e7f942698d48 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.460647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b73e4126bd147dbbb94d34a3281d923', 'request_id': 'req-7a58a809-3b12-47e1-bb78-59d9435d4ab2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.464709 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a639a-efc2-4122-92f1-e7f942698d48 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.525907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.526623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.526795 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.527043 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.527686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:41.527986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.529607 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.541472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1385/2774] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:39:41.546612 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.561986 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c7b0a-f4b1-4ef7-81af-2bdb5369bfe0 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.572104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.572736 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.573012 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.573315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.574004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.575922 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.578750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b73e4126bd147dbbb94d34a3281d923', 'request_id': 'req-7a58a809-3b12-47e1-bb78-59d9435d4ab2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.587981 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b73e4126bd147dbbb94d34a3281d923', 'request_id': 'req-7a58a809-3b12-47e1-bb78-59d9435d4ab2'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.602573 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] The token cache is being invalidate because project 9b73e4126bd147dbbb94d34a3281d923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:41.602942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.603892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-7a58a809-3b12-47e1-bb78-59d9435d4ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:41.605549 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1390/2775] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:41 2022] DELETE /identity/v3/projects/9b73e4126bd147dbbb94d34a3281d923 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:41.612104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d862-d0cc-46b5-9265-8b0d7193fe41 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.612796 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d862-d0cc-46b5-9265-8b0d7193fe41 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.613051 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d862-d0cc-46b5-9265-8b0d7193fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.620108 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:41.637131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-23a0d862-d0cc-46b5-9265-8b0d7193fe41 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:41.638362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-23a0d862-d0cc-46b5-9265-8b0d7193fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.646669 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1391/2776] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:41.655076 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcceb-79cc-47f0-a034-35f84b99d3f7 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.655380 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcceb-79cc-47f0-a034-35f84b99d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.655892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcceb-79cc-47f0-a034-35f84b99d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.679966 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-ef3dcceb-79cc-47f0-a034-35f84b99d3f7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:41.681220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ef3dcceb-79cc-47f0-a034-35f84b99d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.690363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1392/2777] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:41.695252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dcceb-79cc-47f0-a034-35f84b99d3f7 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.704959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dcceb-79cc-47f0-a034-35f84b99d3f7 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.710788 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.711502 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.711793 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.712062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.712833 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:41.713335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.715749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.732490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1393/2778] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:39:41.735791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1386/2779] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:39:41.737114 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.739915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.742161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.748568 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca01f1-7200-43c5-970b-63c932a622df admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.815252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.816490 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.817092 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.817623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.818910 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.821575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.822733 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb25d-bea0-4e1c-88cd-bb1ad69dfc8b admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.835051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.836053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.839778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.839778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.839778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.841913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.003244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1387/2780] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:42.007842 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.009697 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1394/2781] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:39:42.013717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.019346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a037f-7e52-489f-8109-c56ac9af94ed admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.089857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b00f57-526b-48a2-a269-1800df166cce admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.098018 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.098982 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.099261 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.099530 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.100160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.102891 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.107109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.107109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.107109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.107109 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.107941 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.110656 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.128400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1388/2782] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:42.132610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.143559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7568392-8059-424e-a245-a34a29f57e2c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.149645 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.150250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.150522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.150791 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.151424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.153009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.168482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1389/2783] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:42.172172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.183821 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98354f94-a812-4aff-a134-af8106ee84c0 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.193241 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d850f09-ac97-4e4f-ba92-650c70ad6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.194553 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d850f09-ac97-4e4f-ba92-650c70ad6971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.201207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d850f09-ac97-4e4f-ba92-650c70ad6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.201207 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d850f09-ac97-4e4f-ba92-650c70ad6971 admin admin] PATH_INFO: `/v3/projects/db020ac1884240e1b171c3e9202cb237/users/484743739fcf4fc099c82b2ecda975d5/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.227450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1395/2784] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:42 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:42.236220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d850f09-ac97-4e4f-ba92-650c70ad6971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db020ac1884240e1b171c3e9202cb237, user_id=484743739fcf4fc099c82b2ecda975d5, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.236220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d850f09-ac97-4e4f-ba92-650c70ad6971 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.237750 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.248122 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29600e35-652d-440a-82a7-f2ff925595c4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.253327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.253880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.254160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.254546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.255306 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.257448 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.268915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1396/2785] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:42.273838 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.289315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657280c-7ff9-4669-b6bc-3ab55dab15cd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.295085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.295721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.295997 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.296265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.296905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.298601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.309896 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1397/2786] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:42.314262 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.324202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04690ee-7d51-4400-b5e6-8ff68debfbeb admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.339267 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.340415 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.340971 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.341508 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] PATH_INFO: `/v3/projects/d74dea4aad754e12b73c7df2d7677039/users/8ab7d58784ac4c7199ea25df4faf6fff/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.364038 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74dea4aad754e12b73c7df2d7677039, user_id=8ab7d58784ac4c7199ea25df4faf6fff, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.366744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.379773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1390/2787] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:42 2022] PUT /identity/v3/projects/db020ac1884240e1b171c3e9202cb237/users/484743739fcf4fc099c82b2ecda975d5/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:42.393405 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95409bb-bab2-4b82-bdd1-020d2578a656 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.393686 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95409bb-bab2-4b82-bdd1-020d2578a656 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.393952 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95409bb-bab2-4b82-bdd1-020d2578a656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.427622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e95409bb-bab2-4b82-bdd1-020d2578a656 None None] MFA Rules not processed for user `484743739fcf4fc099c82b2ecda975d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:42.440728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e95409bb-bab2-4b82-bdd1-020d2578a656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:42.492656 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1398/2788] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:42 2022] PUT /identity/v3/projects/d74dea4aad754e12b73c7df2d7677039/users/8ab7d58784ac4c7199ea25df4faf6fff/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:42.498105 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1391/2789] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:42.503278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de169-4c94-44aa-a625-2e81ae37153d None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.503623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de169-4c94-44aa-a625-2e81ae37153d None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.503847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de169-4c94-44aa-a625-2e81ae37153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.508779 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.510597 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:42.540832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-1c2de169-4c94-44aa-a625-2e81ae37153d None None] MFA Rules not processed for user `8ab7d58784ac4c7199ea25df4faf6fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:42.543749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1c2de169-4c94-44aa-a625-2e81ae37153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:42.577268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09881e-ec2b-4742-bc1f-ac55dc19684e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.582005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.595327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.595327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.595327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.622225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1392/2790] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:42.628144 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de169-4c94-44aa-a625-2e81ae37153d None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.672318 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.675471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.686872 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1399/2791] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:42.712328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de169-4c94-44aa-a625-2e81ae37153d None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.721688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.722325 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.722657 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.723060 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.723938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.726145 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.917022 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:42.924559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1393/2792] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:42 2022] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:42.929925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.941804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7a216-6d88-4917-ae8d-5ffbcb0974cc service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:43.021967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:43.023363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.023649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.023920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.024633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:43.027330 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:43.035092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:43.216173 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1400/2793] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:42 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:39:43.220495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:43.233658 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77bdf-da64-49b3-b5f9-7c39a1f58c0e admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:43.259110 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:43.260689 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.261258 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.262170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.262741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:43.265868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:43.282924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1394/2794] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:43.300980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:43.315295 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ff4db-410e-4161-9b94-1eae1721daf9 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:43.320815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd480f-6fb2-4f11-8703-0b19ad8c30a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:43.321467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd480f-6fb2-4f11-8703-0b19ad8c30a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.321742 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd480f-6fb2-4f11-8703-0b19ad8c30a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.322008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd480f-6fb2-4f11-8703-0b19ad8c30a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.322698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd480f-6fb2-4f11-8703-0b19ad8c30a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:43.324512 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd480f-6fb2-4f11-8703-0b19ad8c30a1 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:43.336618 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1401/2795] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:43.342630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:43.358590 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6d03d-da30-451b-b2eb-dea0a5315a6c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:43.365308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:43.366000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.367046 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.367552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] PATH_INFO: `/v3/projects/4b7b11f792554121b096c4fb10ad7727/users/914b17da20bb413d84bc2c14790d30cc/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.391404 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7b11f792554121b096c4fb10ad7727, user_id=914b17da20bb413d84bc2c14790d30cc, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:43.396639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:43.564826 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1395/2796] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:43 2022] PUT /identity/v3/projects/4b7b11f792554121b096c4fb10ad7727/users/914b17da20bb413d84bc2c14790d30cc/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:43.577355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a969a-2181-4b99-ae4f-f1805d847ba1 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.577635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a969a-2181-4b99-ae4f-f1805d847ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.577913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a969a-2181-4b99-ae4f-f1805d847ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.607952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-3c9a969a-2181-4b99-ae4f-f1805d847ba1 None None] MFA Rules not processed for user `914b17da20bb413d84bc2c14790d30cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:43.609196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3c9a969a-2181-4b99-ae4f-f1805d847ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:43.685399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1402/2797] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:43.690097 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:43.729898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:43.782480 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0bf2-94f1-4ea1-b532-0f5a88b59d69 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:43.796053 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:43.797393 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.798211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.798595 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.799557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:43.801665 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:43.900279 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:43.938594 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1396/2798] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:43 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:43.942857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a969a-2181-4b99-ae4f-f1805d847ba1 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:43.956628 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a969a-2181-4b99-ae4f-f1805d847ba1 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.025157 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.025774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.026049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.026316 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.026962 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.028925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.133575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1403/2799] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:43 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:44.137817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.149629 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a979-c760-4694-b6a4-d496f9c20469 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.154631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.155246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.155522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.155794 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.156444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.158180 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.170625 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1397/2800] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:44.177625 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.188496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149baa7d-f811-48cf-9221-60f86d98ef9d admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.193510 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.194093 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.197798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.197798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] PATH_INFO: `/v3/projects/f15032b10cea45a2bfd8229338cee87a/users/f0c84aa24b1b458eabea153cb24c93ad/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.214300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15032b10cea45a2bfd8229338cee87a, user_id=f0c84aa24b1b458eabea153cb24c93ad, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.216751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.325536 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1404/2801] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:44 2022] PUT /identity/v3/projects/f15032b10cea45a2bfd8229338cee87a/users/f0c84aa24b1b458eabea153cb24c93ad/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:44.326583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.339523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2111ff-e1c3-48a0-958c-fd66be90eef0 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.412808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0360e-9e4c-4c39-97c6-beb61e21145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.413457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0360e-9e4c-4c39-97c6-beb61e21145c admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.413769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0360e-9e4c-4c39-97c6-beb61e21145c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.414032 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0360e-9e4c-4c39-97c6-beb61e21145c admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.414681 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0360e-9e4c-4c39-97c6-beb61e21145c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.416323 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0360e-9e4c-4c39-97c6-beb61e21145c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.429442 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1398/2802] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:39:44.433980 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.453090 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1962-c498-4cb9-a79c-84c5a9d1a5bf admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.458281 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.463531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.463531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.463531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] PATH_INFO: `/v3/projects/f15032b10cea45a2bfd8229338cee87a/users/f0c84aa24b1b458eabea153cb24c93ad/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.463531 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15032b10cea45a2bfd8229338cee87a, user_id=f0c84aa24b1b458eabea153cb24c93ad, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.469263 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.478478 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1405/2803] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:44 2022] PUT /identity/v3/projects/f15032b10cea45a2bfd8229338cee87a/users/f0c84aa24b1b458eabea153cb24c93ad/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:44.489253 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f96e9-1486-420b-9104-894250770820 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.494034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f96e9-1486-420b-9104-894250770820 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.494034 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f96e9-1486-420b-9104-894250770820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.526622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-9e1f96e9-1486-420b-9104-894250770820 None None] MFA Rules not processed for user `f0c84aa24b1b458eabea153cb24c93ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:44.527953 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9e1f96e9-1486-420b-9104-894250770820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:44.554434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:44.616522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1399/2804] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:44.630292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.648580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:44.668237 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f96e9-1486-420b-9104-894250770820 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.670077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9e1f96e9-1486-420b-9104-894250770820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:44.704818 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42685-f1db-4377-8a6d-e9ade8b9a0bd admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.709229 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5b415-abbe-49b7-952d-390cfa4c2043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.709892 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5b415-abbe-49b7-952d-390cfa4c2043 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.710194 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5b415-abbe-49b7-952d-390cfa4c2043 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.710467 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5b415-abbe-49b7-952d-390cfa4c2043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.738317 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f96e9-1486-420b-9104-894250770820 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.744751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.746502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.746759 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.747730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.750936 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:44.797821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5b415-abbe-49b7-952d-390cfa4c2043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.799940 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5b415-abbe-49b7-952d-390cfa4c2043 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.812470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1406/2805] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:44.898187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.902001 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.911810 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1400/2806] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:45.006124 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2e15-a146-439b-9ee2-a4bbde7ac0c0 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:45.007141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2e15-a146-439b-9ee2-a4bbde7ac0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:45.007333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2e15-a146-439b-9ee2-a4bbde7ac0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:45.028506 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-e62e2e15-a146-439b-9ee2-a4bbde7ac0c0 None None] MFA Rules not processed for user `484743739fcf4fc099c82b2ecda975d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:45.030672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e62e2e15-a146-439b-9ee2-a4bbde7ac0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:45.100991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1407/2807] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:47.149920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:47.151464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:47.163908 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9eb6dc-8787-4282-8352-8c3f6157d23d service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:47.167746 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:47.168368 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:47.168647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:47.168920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:47.242581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:47.244091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:47.253752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1401/2808] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:49.310479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2e15-a146-439b-9ee2-a4bbde7ac0c0 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:49.321519 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2e15-a146-439b-9ee2-a4bbde7ac0c0 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:49.325631 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f28453-4ff8-4815-9550-0277e522b863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:49.326284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f28453-4ff8-4815-9550-0277e522b863 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:49.326601 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f28453-4ff8-4815-9550-0277e522b863 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:49.326913 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f28453-4ff8-4815-9550-0277e522b863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:49.337244 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f28453-4ff8-4815-9550-0277e522b863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:49.338663 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f28453-4ff8-4815-9550-0277e522b863 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:49.348605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1408/2809] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:55.718410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:55.729676 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:55.806112 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7809fff-b16c-4652-90f0-960615a8fe58 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:55.811188 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:55.811828 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:55.812106 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:55.812376 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] PATH_INFO: `/v3/users/8ab7d58784ac4c7199ea25df4faf6fff` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:55.814773 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab7d58784ac4c7199ea25df4faf6fff)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:55.816731 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:56.161481 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab7d58784ac4c7199ea25df4faf6fff'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.176757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab7d58784ac4c7199ea25df4faf6fff'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.185887 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab7d58784ac4c7199ea25df4faf6fff'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.290139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab7d58784ac4c7199ea25df4faf6fff'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.290792 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab7d58784ac4c7199ea25df4faf6fff'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.297628 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1402/2810] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:55 2022] DELETE /identity/v3/users/8ab7d58784ac4c7199ea25df4faf6fff => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:56.302062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:56.302559 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:56.302677 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:56.323240 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:56.324452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:56.389404 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:56.398668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1409/2811] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:56.409004 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:56.410756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:56.482126 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d357c-7344-4df0-8bbb-aab00503546d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:56.486403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:56.489201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:56.489201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:56.489201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:56.498189 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:56.499672 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:56.509803 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1403/2812] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:57.044761 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:57.046355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:57.059877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eafe69-96d5-48d6-b8f9-93dc997e566e None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:57.065680 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:57.066575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:57.067087 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:57.067205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] PATH_INFO: `/v3/projects/d74dea4aad754e12b73c7df2d7677039` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:57.069085 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74dea4aad754e12b73c7df2d7677039)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:57.071063 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:57.181436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74dea4aad754e12b73c7df2d7677039', 'request_id': 'req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.342977 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74dea4aad754e12b73c7df2d7677039', 'request_id': 'req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.356583 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74dea4aad754e12b73c7df2d7677039', 'request_id': 'req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.368633 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] The token cache is being invalidate because project d74dea4aad754e12b73c7df2d7677039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:57.369328 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.369983 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.372073 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1410/2813] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:57 2022] DELETE /identity/v3/projects/d74dea4aad754e12b73c7df2d7677039 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:57.381706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:57.394286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b14ab-6d83-45b9-be6c-faee35b9d6b5 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:57.423573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:57.457866 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:57.458500 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:57.460312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:57.460312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] PATH_INFO: `/v3/users/914b17da20bb413d84bc2c14790d30cc` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:57.460797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914b17da20bb413d84bc2c14790d30cc)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:57.462801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:57.725291 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914b17da20bb413d84bc2c14790d30cc'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.737655 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914b17da20bb413d84bc2c14790d30cc'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.750255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914b17da20bb413d84bc2c14790d30cc'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.914391 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914b17da20bb413d84bc2c14790d30cc'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.915070 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914b17da20bb413d84bc2c14790d30cc'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.922521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1404/2814] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:57 2022] DELETE /identity/v3/users/914b17da20bb413d84bc2c14790d30cc => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:58.656786 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:58.658429 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:58.682611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd9823-9ef7-4520-ab53-d994cbe9ffa0 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:58.759186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:58.759798 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:58.760184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:58.760457 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] PATH_INFO: `/v3/projects/4b7b11f792554121b096c4fb10ad7727` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:58.761715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7b11f792554121b096c4fb10ad7727)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:58.763671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:58.933877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7b11f792554121b096c4fb10ad7727', 'request_id': 'req-1edd5c43-84a4-4056-985a-44bdaeebffbc'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.023232 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7b11f792554121b096c4fb10ad7727', 'request_id': 'req-1edd5c43-84a4-4056-985a-44bdaeebffbc'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.030264 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7b11f792554121b096c4fb10ad7727', 'request_id': 'req-1edd5c43-84a4-4056-985a-44bdaeebffbc'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.047146 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] The token cache is being invalidate because project 4b7b11f792554121b096c4fb10ad7727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:59.047613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.048664 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-1edd5c43-84a4-4056-985a-44bdaeebffbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.051353 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1411/2815] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:58 2022] DELETE /identity/v3/projects/4b7b11f792554121b096c4fb10ad7727 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:59.057446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:59.059033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.073312 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456d239-9135-473f-8d50-1f7903ae4364 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:59.146516 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:59.147172 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.147454 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.147722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] PATH_INFO: `/v3/users/f0c84aa24b1b458eabea153cb24c93ad` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.148961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c84aa24b1b458eabea153cb24c93ad)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:59.151018 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:59.434548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c84aa24b1b458eabea153cb24c93ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.436812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:59.454521 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c84aa24b1b458eabea153cb24c93ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.463033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c84aa24b1b458eabea153cb24c93ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.556193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c84aa24b1b458eabea153cb24c93ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.557094 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c84aa24b1b458eabea153cb24c93ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.565230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1405/2816] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:59 2022] DELETE /identity/v3/users/f0c84aa24b1b458eabea153cb24c93ad => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:59.731509 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cec4-6f5e-4203-84ec-0b38fb1bbb87 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.732222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cec4-6f5e-4203-84ec-0b38fb1bbb87 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.732222 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cec4-6f5e-4203-84ec-0b38fb1bbb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.757701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-3d64cec4-6f5e-4203-84ec-0b38fb1bbb87 None None] MFA Rules not processed for user `684b1a08185b42318ee7a0ede872b599`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:59.759210 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3d64cec4-6f5e-4203-84ec-0b38fb1bbb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.771344 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:59.846605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1412/2817] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:00.267245 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:00.268815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:00.388567 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f3579-e659-4fff-a85e-359a44bf78f5 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:00.396077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:00.397049 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.397741 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.398342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] PATH_INFO: `/v3/projects/f15032b10cea45a2bfd8229338cee87a` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.400365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15032b10cea45a2bfd8229338cee87a)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:00.402707 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:00.566350 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15032b10cea45a2bfd8229338cee87a', 'request_id': 'req-6e285984-475a-44c7-a3e8-49008f0dc0ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.573102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15032b10cea45a2bfd8229338cee87a', 'request_id': 'req-6e285984-475a-44c7-a3e8-49008f0dc0ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.579505 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15032b10cea45a2bfd8229338cee87a', 'request_id': 'req-6e285984-475a-44c7-a3e8-49008f0dc0ad'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.680982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] The token cache is being invalidate because project f15032b10cea45a2bfd8229338cee87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:00.681451 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.682544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-6e285984-475a-44c7-a3e8-49008f0dc0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.684455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1406/2818] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:00 2022] DELETE /identity/v3/projects/f15032b10cea45a2bfd8229338cee87a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:00.689527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755ad93-def0-4d23-acf7-2dc14bc40c37 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.689877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755ad93-def0-4d23-acf7-2dc14bc40c37 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.690161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755ad93-def0-4d23-acf7-2dc14bc40c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.718828 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c755ad93-def0-4d23-acf7-2dc14bc40c37 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:00.719992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c755ad93-def0-4d23-acf7-2dc14bc40c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:00.835292 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1413/2819] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:00.915492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef388f-712d-4511-820a-864556b5d54e None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.917257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef388f-712d-4511-820a-864556b5d54e None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.917257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef388f-712d-4511-820a-864556b5d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.937698 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-8eef388f-712d-4511-820a-864556b5d54e None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:00.938944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8eef388f-712d-4511-820a-864556b5d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:00.948022 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1407/2820] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:00.952440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755ad93-def0-4d23-acf7-2dc14bc40c37 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:00.963579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755ad93-def0-4d23-acf7-2dc14bc40c37 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:00.969192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:00.969623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.969952 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.970228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.970877 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:00.971185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:00.972780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:00.986397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1414/2821] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:00.990750 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef388f-712d-4511-820a-864556b5d54e None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.000577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef388f-712d-4511-820a-864556b5d54e None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.005386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.006092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.006378 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.006748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.007476 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.009780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.140449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1408/2822] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:00 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:01.144782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.155575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f1c8b-a335-47b3-866b-6545e4885bf4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.226118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.226575 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.226857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.227129 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.227780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.229749 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.323991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1415/2823] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:01.325205 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.337347 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e628-466b-43e3-abbc-ab3d2af1482d admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.343916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.343916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.343916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.343916 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.344664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.346716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.359429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1409/2824] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:01.365370 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.375627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db46ed4-345d-4cfa-b5cc-29d0096b252e admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.381280 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5d3c6-2e9f-4dd9-b75d-43194a0b7e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.381869 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5d3c6-2e9f-4dd9-b75d-43194a0b7e04 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.382152 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5d3c6-2e9f-4dd9-b75d-43194a0b7e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.382470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5d3c6-2e9f-4dd9-b75d-43194a0b7e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.383089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5d3c6-2e9f-4dd9-b75d-43194a0b7e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.384713 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5d3c6-2e9f-4dd9-b75d-43194a0b7e04 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.399358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1416/2825] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:40:01.405228 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.418544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3cc4f-5620-474a-8bd6-7d1368449ceb admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.423753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.424426 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.424710 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.424970 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] PATH_INFO: `/v3/projects/8de3914664334b8c880763f6c28186c3/users/f03a6c0a7693436ebb6a10abe11187b7/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.428573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:01.441484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de3914664334b8c880763f6c28186c3, user_id=f03a6c0a7693436ebb6a10abe11187b7, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.444735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.538789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1410/2826] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:01 2022] PUT /identity/v3/projects/8de3914664334b8c880763f6c28186c3/users/f03a6c0a7693436ebb6a10abe11187b7/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:01.550556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bd11d-399d-4d2a-b9de-f4b34c82c17c None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.550857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bd11d-399d-4d2a-b9de-f4b34c82c17c None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.551163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bd11d-399d-4d2a-b9de-f4b34c82c17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.582200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-504bd11d-399d-4d2a-b9de-f4b34c82c17c None None] MFA Rules not processed for user `f03a6c0a7693436ebb6a10abe11187b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:01.583641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-504bd11d-399d-4d2a-b9de-f4b34c82c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:01.597394 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:01.657725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1417/2827] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:01.662434 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.731270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7fc99-ea56-4b59-9952-85c4978d248c admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.736196 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.736845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.737169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.741453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.741453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.741453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.851470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1411/2828] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:01.860268 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bd11d-399d-4d2a-b9de-f4b34c82c17c None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.871511 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bd11d-399d-4d2a-b9de-f4b34c82c17c None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.948109 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.948925 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.949398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.949766 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.950703 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.952707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.061305 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1418/2829] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:02.065472 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.078496 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc59c6-4b33-419e-b8da-1f800e538f30 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.083185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.083793 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.084210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.084679 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.085437 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.087033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.098668 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1412/2830] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:02.103300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.113333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451774e3-312a-4553-8c24-b0607fcac13b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.118907 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121d7f-847a-4725-9c14-de94aab1c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.119515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121d7f-847a-4725-9c14-de94aab1c926 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.119795 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121d7f-847a-4725-9c14-de94aab1c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.120069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121d7f-847a-4725-9c14-de94aab1c926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.120711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121d7f-847a-4725-9c14-de94aab1c926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.122354 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121d7f-847a-4725-9c14-de94aab1c926 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.138021 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.138464 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1419/2831] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:02.149482 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44265-6cd6-4c46-b559-d8334469ed99 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.154577 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.155669 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.155957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.156236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] PATH_INFO: `/v3/projects/db580523115840a6b2552a4f94ea5fa3/users/cb20bd9afeff4a7898514064a9c40afd/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.176138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db580523115840a6b2552a4f94ea5fa3, user_id=cb20bd9afeff4a7898514064a9c40afd, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.180164 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.243771 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1413/2832] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:02 2022] PUT /identity/v3/projects/db580523115840a6b2552a4f94ea5fa3/users/cb20bd9afeff4a7898514064a9c40afd/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:02.254968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87553f6a-35bf-4ae6-baf6-15ba1cdc721a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.255662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87553f6a-35bf-4ae6-baf6-15ba1cdc721a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.255662 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87553f6a-35bf-4ae6-baf6-15ba1cdc721a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.290419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-87553f6a-35bf-4ae6-baf6-15ba1cdc721a None None] MFA Rules not processed for user `cb20bd9afeff4a7898514064a9c40afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:02.291721 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-87553f6a-35bf-4ae6-baf6-15ba1cdc721a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:02.362736 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1420/2833] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:02.367580 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.435187 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9229b57-5071-4b67-97df-35a63495a632 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.439950 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.440538 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.440816 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.441113 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.441756 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.444220 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.570051 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1414/2834] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:02 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:02.575067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87553f6a-35bf-4ae6-baf6-15ba1cdc721a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.586520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87553f6a-35bf-4ae6-baf6-15ba1cdc721a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.606303 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:02.647053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.647665 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.647942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.648213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.648857 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.650802 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.728005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1421/2835] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:02 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:02.732604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.743798 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a7112-e36f-4f94-8f02-8d67f2d87eb6 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.748515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.749181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.749464 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.749740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.750385 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.751997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.763616 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1415/2836] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:02.767921 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.778335 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b8a3f-6025-4194-8ec1-d8ecb3650fc8 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.783009 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.783667 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.783943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.784216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] PATH_INFO: `/v3/projects/8e3a4221d24346b983e396cdf70c6f9c/users/f26a6e5e9ba249719c7800b2e16b220f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.800640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3a4221d24346b983e396cdf70c6f9c, user_id=f26a6e5e9ba249719c7800b2e16b220f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.804033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.891700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1422/2837] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:02 2022] PUT /identity/v3/projects/8e3a4221d24346b983e396cdf70c6f9c/users/f26a6e5e9ba249719c7800b2e16b220f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:02.896299 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.910287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e4af4-9d0e-40d4-9452-039f14907135 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.923388 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:02.995399 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b750-1941-4cf1-99ea-8ca968ccefda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.996020 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b750-1941-4cf1-99ea-8ca968ccefda admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.996304 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b750-1941-4cf1-99ea-8ca968ccefda admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.997210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b750-1941-4cf1-99ea-8ca968ccefda admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.998305 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b750-1941-4cf1-99ea-8ca968ccefda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.999527 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b750-1941-4cf1-99ea-8ca968ccefda admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:03.010701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1416/2838] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:40:03.014885 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:03.026725 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bc4f7-4a50-4026-a55b-cff27613e009 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:03.033723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:03.036178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:03.036178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:03.036178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] PATH_INFO: `/v3/projects/8e3a4221d24346b983e396cdf70c6f9c/users/f26a6e5e9ba249719c7800b2e16b220f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.037707 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3a4221d24346b983e396cdf70c6f9c, user_id=f26a6e5e9ba249719c7800b2e16b220f, role_id=c68d8e3fc79c47a1a950f0b4bb08a17e)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:03.040758 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:03.052608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1423/2839] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:03 2022] PUT /identity/v3/projects/8e3a4221d24346b983e396cdf70c6f9c/users/f26a6e5e9ba249719c7800b2e16b220f/roles/c68d8e3fc79c47a1a950f0b4bb08a17e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:03.064266 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb80ec5-e580-4f49-906f-8b037175cbb8 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:03.064546 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb80ec5-e580-4f49-906f-8b037175cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:03.064820 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb80ec5-e580-4f49-906f-8b037175cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.094944 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-dfb80ec5-e580-4f49-906f-8b037175cbb8 None None] MFA Rules not processed for user `f26a6e5e9ba249719c7800b2e16b220f`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:03.096175 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-dfb80ec5-e580-4f49-906f-8b037175cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:03.175770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1417/2840] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:03.188789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:03.190821 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:03.255447 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff088a4-36e7-473b-995b-7aff18391f1b admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:03.260412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:03.261743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:03.261743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:03.261743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.323627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:03.325195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:03.335184 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1424/2841] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:05.411906 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb80ec5-e580-4f49-906f-8b037175cbb8 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:05.422446 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb80ec5-e580-4f49-906f-8b037175cbb8 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:05.426185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:05.426942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.427225 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.427510 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:05.497035 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:05.498663 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:05.508107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1418/2842] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:07.260195 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:07.270186 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161df42a-9d56-4ca4-9aa6-794b41adc724 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:07.274792 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:07.275739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.275739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.276062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.287863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:07.289443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:07.299603 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1425/2843] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:07.489604 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:07.491263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:07.538845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=100 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:07.578252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029361e-2979-4d6d-80e0-9d6ce55ce7f3 service cinder] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:07.586170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec8026-df22-489a-a29f-01e61e18c2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:07.586999 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8026-df22-489a-a29f-01e61e18c2df service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.587283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8026-df22-489a-a29f-01e61e18c2df service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.587562 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8026-df22-489a-a29f-01e61e18c2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.589565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7aec8026-df22-489a-a29f-01e61e18c2df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:07.697694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec8026-df22-489a-a29f-01e61e18c2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:07.699263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec8026-df22-489a-a29f-01e61e18c2df service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:07.713194 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1419/2844] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:08.931160 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.932666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:08.946118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22a7c-238a-4b81-a625-abd226770023 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.949965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.950678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.950847 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.951117 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.952922 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:08.973333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.975486 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.989419 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1426/2845] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:11.921760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4ea51-cf39-42fe-a36a-eb95249c79af None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.921760 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4ea51-cf39-42fe-a36a-eb95249c79af None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.922412 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4ea51-cf39-42fe-a36a-eb95249c79af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.943436 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-e3f4ea51-cf39-42fe-a36a-eb95249c79af None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:11.944570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-e3f4ea51-cf39-42fe-a36a-eb95249c79af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:12.003416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1420/2846] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:12.187347 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:12.190740 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:12.200807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:12.291422 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44ca52-fa01-48c1-afa5-299acfce2a17 service neutron] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:12.298803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da411-5374-423e-b8ef-e98553a97e47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:12.299427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da411-5374-423e-b8ef-e98553a97e47 service swift] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.299730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da411-5374-423e-b8ef-e98553a97e47 service swift] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.300006 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da411-5374-423e-b8ef-e98553a97e47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.310731 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da411-5374-423e-b8ef-e98553a97e47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:12.312360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da411-5374-423e-b8ef-e98553a97e47 service swift] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:12.322288 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1427/2847] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:12.511878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4ea51-cf39-42fe-a36a-eb95249c79af None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:12.587301 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4ea51-cf39-42fe-a36a-eb95249c79af None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:12.593583 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:12.594271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.594552 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.594825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] PATH_INFO: `/v3/users/f03a6c0a7693436ebb6a10abe11187b7` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.596062 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03a6c0a7693436ebb6a10abe11187b7)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:12.598530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:12.623893 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:12.834536 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03a6c0a7693436ebb6a10abe11187b7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:12.849010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03a6c0a7693436ebb6a10abe11187b7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:12.857458 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03a6c0a7693436ebb6a10abe11187b7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:12.953581 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03a6c0a7693436ebb6a10abe11187b7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:12.960700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03a6c0a7693436ebb6a10abe11187b7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:12.967926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1421/2848] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:12 2022] DELETE /identity/v3/users/f03a6c0a7693436ebb6a10abe11187b7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:12.972561 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192c9e-1ce4-4512-9305-42d7dddf2d53 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.973131 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192c9e-1ce4-4512-9305-42d7dddf2d53 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.973416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192c9e-1ce4-4512-9305-42d7dddf2d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.993868 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-80192c9e-1ce4-4512-9305-42d7dddf2d53 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:12.995083 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-80192c9e-1ce4-4512-9305-42d7dddf2d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:13.072909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1428/2849] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:13.084061 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:13.086067 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:13.153270 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beece5a6-163b-46ee-a211-64d62b3e0342 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:13.157883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:13.158511 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.158799 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.159371 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.170719 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:13.172229 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:13.182871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1422/2850] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:13.418867 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.419399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.419399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.439505 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:13.440717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:13.515705 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1429/2851] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:13.526608 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:13.530769 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:13.652520 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a17e1-f068-495a-b9d0-6eb0b39989f5 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:13.659947 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:13.660670 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.660874 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.661183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.671806 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:13.673515 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:13.685470 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1423/2852] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:13.783577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:13.783577 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:13.804416 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349c1b-fad0-4d42-baf6-82bebb5f7469 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:13.810504 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:13.812580 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.812921 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.817473 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] PATH_INFO: `/v3/projects/8de3914664334b8c880763f6c28186c3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.820356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de3914664334b8c880763f6c28186c3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:13.823069 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:13.971666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:14.006783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de3914664334b8c880763f6c28186c3', 'request_id': 'req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.087057 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de3914664334b8c880763f6c28186c3', 'request_id': 'req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.093207 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de3914664334b8c880763f6c28186c3', 'request_id': 'req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.106565 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] The token cache is being invalidate because project 8de3914664334b8c880763f6c28186c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:14.106894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.107533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-f29b0dd3-b0d0-43e3-9f65-0c29a4e3c969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.109139 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1430/2853] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:13 2022] DELETE /identity/v3/projects/8de3914664334b8c880763f6c28186c3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:14.113324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:14.125236 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f53a0-dc11-453c-a5b7-b089c00a5906 service swift] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:14.154823 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:14.199622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:14.200517 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.200932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.201337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] PATH_INFO: `/v3/users/cb20bd9afeff4a7898514064a9c40afd` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.203138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb20bd9afeff4a7898514064a9c40afd)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:14.205219 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:14.447077 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb20bd9afeff4a7898514064a9c40afd'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.466739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb20bd9afeff4a7898514064a9c40afd'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.472118 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.473436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.473436 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.481725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb20bd9afeff4a7898514064a9c40afd'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.499334 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:14.500640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:14.565757 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb20bd9afeff4a7898514064a9c40afd'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.566694 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb20bd9afeff4a7898514064a9c40afd'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:14.575814 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1431/2854] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:14.578342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1424/2855] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:14 2022] DELETE /identity/v3/users/cb20bd9afeff4a7898514064a9c40afd => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:14.593480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:14.595905 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:14.694242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9ade-b672-4475-b563-214b61901e7b None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:14.780998 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba70d-e2be-45b6-ab03-4d920004521b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:14.781659 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba70d-e2be-45b6-ab03-4d920004521b service swift] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.781932 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba70d-e2be-45b6-ab03-4d920004521b service swift] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.782197 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba70d-e2be-45b6-ab03-4d920004521b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.792471 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:14.858919 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ba70d-e2be-45b6-ab03-4d920004521b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:14.860554 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ba70d-e2be-45b6-ab03-4d920004521b service swift] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:14.870056 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1432/2856] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:40:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:15.260768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:15.263303 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:15.373375 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed13948-7b36-480f-a834-be8bacc0ee50 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:15.384849 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:15.385674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.386403 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.386752 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] PATH_INFO: `/v3/projects/db580523115840a6b2552a4f94ea5fa3` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.388239 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db580523115840a6b2552a4f94ea5fa3)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:15.390384 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:15.530942 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:15.532895 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db580523115840a6b2552a4f94ea5fa3', 'request_id': 'req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:15.539962 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db580523115840a6b2552a4f94ea5fa3', 'request_id': 'req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:15.547394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db580523115840a6b2552a4f94ea5fa3', 'request_id': 'req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:15.645192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.646095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.646095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.671141 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] MFA Rules not processed for user `721ea6f0f684481a89a92ff264cc9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:15.672392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:15.690850 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] The token cache is being invalidate because project db580523115840a6b2552a4f94ea5fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:15.691386 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:15.692444 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:15.694925 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1425/2857] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:15 2022] DELETE /identity/v3/projects/db580523115840a6b2552a4f94ea5fa3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:15.699585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:15.701287 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:15.762067 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1433/2858] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:15.777225 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:15.779074 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:15.796283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c852d-d4f4-4e82-8b1a-57e09dcd867a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:15.802271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:15.803120 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.803502 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.803786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] PATH_INFO: `/v3/users/f26a6e5e9ba249719c7800b2e16b220f` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.805124 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26a6e5e9ba249719c7800b2e16b220f)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:15.807080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:15.865944 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31569-fedc-41c8-a8bb-838269b15046 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:15.871162 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afacbc4812494825a43083cbba245e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:15.878813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.878813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.878813 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.882682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:15.884293 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:15.893398 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1434/2859] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 21:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:16.018174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26a6e5e9ba249719c7800b2e16b220f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.035324 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26a6e5e9ba249719c7800b2e16b220f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.042892 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26a6e5e9ba249719c7800b2e16b220f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.121761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26a6e5e9ba249719c7800b2e16b220f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.122728 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-00a1da5a-7635-4640-a6ed-5109de9063e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26a6e5e9ba249719c7800b2e16b220f'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.139513 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1426/2860] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:15 2022] DELETE /identity/v3/users/f26a6e5e9ba249719c7800b2e16b220f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:16.681546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:16.692425 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add1bc-91a5-47ea-9aa7-0e461e546c37 service swift] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:16.740974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=100 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:16.756889 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:16.757595 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:16.757894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:16.758196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] PATH_INFO: `/v3/projects/8e3a4221d24346b983e396cdf70c6f9c` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:16.759851 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3a4221d24346b983e396cdf70c6f9c)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:16.761840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:16.894418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3a4221d24346b983e396cdf70c6f9c', 'request_id': 'req-cc8f763a-41ad-43e6-b698-5ba29c1b666c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.978563 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3a4221d24346b983e396cdf70c6f9c', 'request_id': 'req-cc8f763a-41ad-43e6-b698-5ba29c1b666c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.984582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3a4221d24346b983e396cdf70c6f9c', 'request_id': 'req-cc8f763a-41ad-43e6-b698-5ba29c1b666c'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.996363 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] The token cache is being invalidate because project 8e3a4221d24346b983e396cdf70c6f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:16.996647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.997427 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-cc8f763a-41ad-43e6-b698-5ba29c1b666c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:16.998955 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1435/2861] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:16 2022] DELETE /identity/v3/projects/8e3a4221d24346b983e396cdf70c6f9c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:17.003963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e4ee-c178-451c-a972-5efb6c5c14b3 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.004653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e4ee-c178-451c-a972-5efb6c5c14b3 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.004653 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e4ee-c178-451c-a972-5efb6c5c14b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.025687 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-ccf7e4ee-c178-451c-a972-5efb6c5c14b3 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:17.026982 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-ccf7e4ee-c178-451c-a972-5efb6c5c14b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:17.078337 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:17.089937 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1427/2862] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:17.098753 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff3957-e235-4c02-8bb5-797a77b31482 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.099540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff3957-e235-4c02-8bb5-797a77b31482 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.099807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff3957-e235-4c02-8bb5-797a77b31482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.123001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-63ff3957-e235-4c02-8bb5-797a77b31482 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:17.124635 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-63ff3957-e235-4c02-8bb5-797a77b31482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:17.133883 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1436/2863] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:17.138336 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e4ee-c178-451c-a972-5efb6c5c14b3 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.148640 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e4ee-c178-451c-a972-5efb6c5c14b3 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.152924 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.153675 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.153956 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.154227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.154883 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:17.155183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.156785 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.170569 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1428/2864] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:17.175185 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff3957-e235-4c02-8bb5-797a77b31482 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.185640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff3957-e235-4c02-8bb5-797a77b31482 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.190372 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.190964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.191238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.191507 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.192133 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.194246 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.315205 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1437/2865] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:17 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:17.318484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.330490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f176f-0308-4379-9460-a8a052aff9ce admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.400221 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.401000 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.401298 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.401636 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.406201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.406201 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.510184 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1429/2866] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:17 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:17.516115 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.528026 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874b21-c3db-4916-8faf-ba600acd1646 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.533253 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.533860 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.534137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.534407 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.535220 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.537538 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.548322 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1438/2867] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:17.552702 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.563244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e43e6-d481-43db-9764-b3c687ea47ca admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.568140 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab86a5-b189-4057-857d-a0ec30d995a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.568744 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab86a5-b189-4057-857d-a0ec30d995a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.569026 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab86a5-b189-4057-857d-a0ec30d995a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.569331 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab86a5-b189-4057-857d-a0ec30d995a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.569975 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab86a5-b189-4057-857d-a0ec30d995a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.572091 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab86a5-b189-4057-857d-a0ec30d995a5 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.583722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1430/2868] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:17.589084 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.600410 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22f96-f728-49a0-8cb2-c3e3d1c02809 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.604992 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.605668 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.605946 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.606273 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] PATH_INFO: `/v3/projects/ce90b8d5da2c49b495e7a679e3095da8/users/99d4b7f3f3b94e6487f44ee157c94485/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.621755 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90b8d5da2c49b495e7a679e3095da8, user_id=99d4b7f3f3b94e6487f44ee157c94485, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.624392 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.733107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1439/2869] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:17 2022] PUT /identity/v3/projects/ce90b8d5da2c49b495e7a679e3095da8/users/99d4b7f3f3b94e6487f44ee157c94485/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:17.745169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.745169 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.745790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.777490 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] MFA Rules not processed for user `99d4b7f3f3b94e6487f44ee157c94485`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:17.778825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:17.848367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1431/2870] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:17.860564 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.862401 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:17.923551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c34b9-0a86-4aa1-868f-617092d7f3a7 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.927488 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a8f2d-cd34-4343-ae0b-8686f36597a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b56b3fafca1e47f88482bf25a77a0fea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.928095 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8f2d-cd34-4343-ae0b-8686f36597a0 service glance] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.928371 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8f2d-cd34-4343-ae0b-8686f36597a0 service glance] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.928640 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8f2d-cd34-4343-ae0b-8686f36597a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.937154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a8f2d-cd34-4343-ae0b-8686f36597a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.938719 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a8f2d-cd34-4343-ae0b-8686f36597a0 service glance] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.948291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1440/2871] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:18.880484 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:18.882121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:18.943343 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:18.959541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c87815-b68a-49ef-947f-981914fe4588 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:18.964429 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:18.965193 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:18.965475 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:18.965825 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] PATH_INFO: `/v3/users/484743739fcf4fc099c82b2ecda975d5` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:18.967037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484743739fcf4fc099c82b2ecda975d5)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:18.969508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:19.167859 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484743739fcf4fc099c82b2ecda975d5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:19.179976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484743739fcf4fc099c82b2ecda975d5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:19.186815 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484743739fcf4fc099c82b2ecda975d5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:19.275297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484743739fcf4fc099c82b2ecda975d5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:19.275928 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484743739fcf4fc099c82b2ecda975d5'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:19.282712 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1432/2872] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:18 2022] DELETE /identity/v3/users/484743739fcf4fc099c82b2ecda975d5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:19.287774 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b17db-1afc-43d7-885e-7476542fba35 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.288310 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b17db-1afc-43d7-885e-7476542fba35 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.288435 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b17db-1afc-43d7-885e-7476542fba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.308826 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-346b17db-1afc-43d7-885e-7476542fba35 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:19.310107 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-346b17db-1afc-43d7-885e-7476542fba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:19.320213 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:19.385308 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1441/2873] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:19.396211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:19.397701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:19.457427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba66e4-b2f1-4a60-a440-1bb3ce3a03c7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:19.461889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:19.462503 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.462783 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.463056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.472523 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:19.474261 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:19.483932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1433/2874] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:19.487446 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.487724 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.488017 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.510912 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:19.512070 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:19.521265 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1442/2875] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:19.547559 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:19.549913 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:19.651210 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29f57-1fec-4c67-bda4-9aae7fd749a8 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:19.656889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cd555-2230-44bb-bd84-ef9a93e08a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:19.657533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cd555-2230-44bb-bd84-ef9a93e08a35 service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.657808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cd555-2230-44bb-bd84-ef9a93e08a35 service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.658080 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cd555-2230-44bb-bd84-ef9a93e08a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.666808 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cd555-2230-44bb-bd84-ef9a93e08a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:19.668730 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cd555-2230-44bb-bd84-ef9a93e08a35 service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:19.673127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:19.681168 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1434/2876] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:19.810161 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:19.811785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:19.827327 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770aa09-d99b-42b6-a3e8-992b1c17d491 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:19.832647 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:19.833376 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.833700 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.834072 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] PATH_INFO: `/v3/projects/db020ac1884240e1b171c3e9202cb237` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.835256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db020ac1884240e1b171c3e9202cb237)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:19.837211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:20.001687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db020ac1884240e1b171c3e9202cb237', 'request_id': 'req-61230d3d-918c-4e34-aaf9-fa420e6b2451'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:20.084112 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db020ac1884240e1b171c3e9202cb237', 'request_id': 'req-61230d3d-918c-4e34-aaf9-fa420e6b2451'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:20.091859 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db020ac1884240e1b171c3e9202cb237', 'request_id': 'req-61230d3d-918c-4e34-aaf9-fa420e6b2451'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:20.106236 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] The token cache is being invalidate because project db020ac1884240e1b171c3e9202cb237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:20.106527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:20.107189 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:20.108739 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1443/2877] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:19 2022] DELETE /identity/v3/projects/db020ac1884240e1b171c3e9202cb237 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:23.979227 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215474-763c-49e3-903c-18f6a12c7a21 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:23.979797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215474-763c-49e3-903c-18f6a12c7a21 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:23.979797 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215474-763c-49e3-903c-18f6a12c7a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:24.000718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-fd215474-763c-49e3-903c-18f6a12c7a21 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:24.001989 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fd215474-763c-49e3-903c-18f6a12c7a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:24.068242 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1435/2878] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:24.099480 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:24.100943 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:24.185326 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61230d3d-918c-4e34-aaf9-fa420e6b2451 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:24.193476 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:24.194121 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:24.194399 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:24.194646 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:24.203978 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:24.205582 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:24.216103 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1444/2879] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:28.840680 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae1c6a-407e-416f-bdec-6b7c0c1a7ecc None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:28.841226 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae1c6a-407e-416f-bdec-6b7c0c1a7ecc None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:28.841315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae1c6a-407e-416f-bdec-6b7c0c1a7ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:28.868134 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-2aae1c6a-407e-416f-bdec-6b7c0c1a7ecc None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:28.869487 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-2aae1c6a-407e-416f-bdec-6b7c0c1a7ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:28.877817 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1436/2880] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:28.904723 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:28.906238 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:28.922557 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c653a0-d6a9-45ea-b3a6-4b5eeb253464 service nova] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:28.928491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:28.929178 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:28.929493 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:28.929762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:28.939200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:28.940901 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:28.952481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1445/2881] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:32.092247 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9058-4889-4fde-8f55-1541c1fa9fbb None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:32.092938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9058-4889-4fde-8f55-1541c1fa9fbb None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:32.092938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9058-4889-4fde-8f55-1541c1fa9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:32.114316 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-afef9058-4889-4fde-8f55-1541c1fa9fbb None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:32.115455 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-afef9058-4889-4fde-8f55-1541c1fa9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:32.123551 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1437/2882] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:32.152337 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:32.158465 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:32.165097 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6d62-9a72-4b92-8889-3c3ce0055248 service nova] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:32.170965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:32.171587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:32.171863 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:32.172137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:32.182104 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:32.183613 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:32.193951 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1446/2883] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:36.390460 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.391019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.391019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.411268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:36.412501 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:36.420997 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1438/2884] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 29 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:36.447620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.466269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfa593-5c43-4266-a344-78074ebfeaa5 service nova] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.474769 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1d35e-60a9-4779-8d00-54712481888f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.475732 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1d35e-60a9-4779-8d00-54712481888f service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.476191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1d35e-60a9-4779-8d00-54712481888f service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.476632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1d35e-60a9-4779-8d00-54712481888f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.491670 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1d35e-60a9-4779-8d00-54712481888f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.493965 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1d35e-60a9-4779-8d00-54712481888f service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.506807 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1447/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:45.893878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:45.894901 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:45.907252 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf25b2f-2cf1-493d-8fd6-42ab05855e50 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:45.912400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:45.913033 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:45.913341 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:45.913613 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] PATH_INFO: `/v3/users/99d4b7f3f3b94e6487f44ee157c94485` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:45.914753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d4b7f3f3b94e6487f44ee157c94485)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:45.916770 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:46.203584 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d4b7f3f3b94e6487f44ee157c94485'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:46.218886 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d4b7f3f3b94e6487f44ee157c94485'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:46.228639 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d4b7f3f3b94e6487f44ee157c94485'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:46.313868 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d4b7f3f3b94e6487f44ee157c94485'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:46.314837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d4b7f3f3b94e6487f44ee157c94485'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:46.322508 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1439/2886] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:45 2022] DELETE /identity/v3/users/99d4b7f3f3b94e6487f44ee157c94485 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:46.328374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:46.328374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:46.328374 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:46.354975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:46.356678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:46.429714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1448/2887] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:46.440485 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:46.442740 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:46.515114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483151e-1c58-492a-8d80-0a6dd31eac72 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:46.518765 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023382a-e20a-4079-9eb1-810bba13d5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:46.520056 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023382a-e20a-4079-9eb1-810bba13d5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:46.520257 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023382a-e20a-4079-9eb1-810bba13d5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:46.520525 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023382a-e20a-4079-9eb1-810bba13d5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:46.526571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:46.530666 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023382a-e20a-4079-9eb1-810bba13d5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:46.532166 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023382a-e20a-4079-9eb1-810bba13d5d5 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:46.544739 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1440/2888] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:47.001897 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.003444 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:47.033787 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170fbf-56b7-4b56-a7c0-577aa3df3c88 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.042393 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.043333 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.043743 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.044159 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] PATH_INFO: `/v3/projects/ce90b8d5da2c49b495e7a679e3095da8` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.045623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce90b8d5da2c49b495e7a679e3095da8)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.047979 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.224079 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce90b8d5da2c49b495e7a679e3095da8', 'request_id': 'req-209d708a-82f8-4203-9ca7-18b37488a632'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.290718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce90b8d5da2c49b495e7a679e3095da8', 'request_id': 'req-209d708a-82f8-4203-9ca7-18b37488a632'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.299269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce90b8d5da2c49b495e7a679e3095da8', 'request_id': 'req-209d708a-82f8-4203-9ca7-18b37488a632'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.318687 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] The token cache is being invalidate because project ce90b8d5da2c49b495e7a679e3095da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:47.319782 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.320974 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-209d708a-82f8-4203-9ca7-18b37488a632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.323546 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1449/2889] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:47 2022] DELETE /identity/v3/projects/ce90b8d5da2c49b495e7a679e3095da8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:47.330345 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602aef8-60cc-4bbe-9832-048a9f243d40 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.331154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602aef8-60cc-4bbe-9832-048a9f243d40 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.331154 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602aef8-60cc-4bbe-9832-048a9f243d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.356751 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-3602aef8-60cc-4bbe-9832-048a9f243d40 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:47.358934 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-3602aef8-60cc-4bbe-9832-048a9f243d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:47.434092 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1441/2890] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:47.443440 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11720-d3ea-407c-ac86-1248e954e481 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.444040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11720-d3ea-407c-ac86-1248e954e481 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.444040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11720-d3ea-407c-ac86-1248e954e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.468053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0fe11720-d3ea-407c-ac86-1248e954e481 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:47.469460 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0fe11720-d3ea-407c-ac86-1248e954e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:47.479120 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1450/2891] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:47.483918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602aef8-60cc-4bbe-9832-048a9f243d40 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.495186 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602aef8-60cc-4bbe-9832-048a9f243d40 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.501204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.501843 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.502129 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.502435 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.503234 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:47.504246 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.505910 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.522177 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1442/2892] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:47.527187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe11720-d3ea-407c-ac86-1248e954e481 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.545806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe11720-d3ea-407c-ac86-1248e954e481 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.555008 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.556065 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.556827 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.557361 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.558696 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.562785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.730201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1451/2893] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:47 2022] POST /identity/v3/projects => generated 363 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:47.734491 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.745963 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c729bb-30d8-4926-ad2b-ebeacc9c0337 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.813185 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.813801 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.814079 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.814340 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.815009 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.817848 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.943615 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1443/2894] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:47 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:47.947967 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.967604 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d768-935d-4b3b-b5b4-5c127d926878 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.972685 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.973343 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.973620 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.973887 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.974541 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.976192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.994710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1452/2895] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:47.997695 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:48.009465 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb437-2d3d-4612-a406-10014bc8a2a3 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:48.014630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3fd1e-3231-4556-9c56-31fb93ea7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:48.030409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3fd1e-3231-4556-9c56-31fb93ea7271 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:48.030409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3fd1e-3231-4556-9c56-31fb93ea7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:48.030409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3fd1e-3231-4556-9c56-31fb93ea7271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:48.030409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3fd1e-3231-4556-9c56-31fb93ea7271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:48.030409 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3fd1e-3231-4556-9c56-31fb93ea7271 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:48.032230 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1444/2896] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:48.036701 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:48.047767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d10a3b-c2f9-41cd-915a-90781b579c12 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:48.052397 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:48.053156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:48.053384 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:48.053666 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] PATH_INFO: `/v3/projects/893a1e4537a34c81bccf5b6c45a015a3/users/2bfe86ad00a844ed8cc486f1b2589dc4/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:48.072136 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893a1e4537a34c81bccf5b6c45a015a3, user_id=2bfe86ad00a844ed8cc486f1b2589dc4, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:48.074902 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:48.078315 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:48.184360 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1453/2897] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:48 2022] PUT /identity/v3/projects/893a1e4537a34c81bccf5b6c45a015a3/users/2bfe86ad00a844ed8cc486f1b2589dc4/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:48.197706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:48.198005 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:48.198283 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:48.230570 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] MFA Rules not processed for user `2bfe86ad00a844ed8cc486f1b2589dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:48.231814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:48.286847 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:48.310918 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1445/2898] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:48.324441 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:48.326276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:48.396727 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71045fb3-1aee-4ccb-8106-61d11531d425 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:48.411900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:48.411900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:48.411900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:48.411900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:48.416405 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:48.417894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:48.428454 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1454/2899] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:59.091114 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=5 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:59.273900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=28 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:11.328127 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:11.349198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:11.401775 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b64f61-a485-4838-92cd-8e6f3bb35e08 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:11.406339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:11.407072 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:11.407297 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:11.407573 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] PATH_INFO: `/v3/users/684b1a08185b42318ee7a0ede872b599` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:11.408716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=684b1a08185b42318ee7a0ede872b599)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:11.410871 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:11.647232 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684b1a08185b42318ee7a0ede872b599'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.660157 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684b1a08185b42318ee7a0ede872b599'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.667017 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684b1a08185b42318ee7a0ede872b599'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.775700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684b1a08185b42318ee7a0ede872b599'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.776346 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-dc281cb1-9090-49a8-be17-5de8536f4b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684b1a08185b42318ee7a0ede872b599'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.782857 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1446/2900] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:11 2022] DELETE /identity/v3/users/684b1a08185b42318ee7a0ede872b599 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:12.075345 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.090256 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727dc4e-4f8e-4073-855f-3aef087a2f92 service cinder] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:12.153245 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:12.153880 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.154187 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.154461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] PATH_INFO: `/v3/projects/ebe42d9914fb472dab2ff9c3a18fbf99` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.155608 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe42d9914fb472dab2ff9c3a18fbf99)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:12.157587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.320461 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe42d9914fb472dab2ff9c3a18fbf99', 'request_id': 'req-fb748921-b363-4a70-bd76-72281e703ff6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.393036 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe42d9914fb472dab2ff9c3a18fbf99', 'request_id': 'req-fb748921-b363-4a70-bd76-72281e703ff6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.399276 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe42d9914fb472dab2ff9c3a18fbf99', 'request_id': 'req-fb748921-b363-4a70-bd76-72281e703ff6'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.410641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] The token cache is being invalidate because project ebe42d9914fb472dab2ff9c3a18fbf99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:12.413497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.413497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-fb748921-b363-4a70-bd76-72281e703ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.413497 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1455/2901] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:12 2022] DELETE /identity/v3/projects/ebe42d9914fb472dab2ff9c3a18fbf99 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:12.418161 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958d54-1c12-444c-807d-9f0d581205c2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.418643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958d54-1c12-444c-807d-9f0d581205c2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.418778 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958d54-1c12-444c-807d-9f0d581205c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.442179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-fe958d54-1c12-444c-807d-9f0d581205c2 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:12.443469 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-fe958d54-1c12-444c-807d-9f0d581205c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:12.511917 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1447/2902] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:12.519714 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a515-3b8d-48d3-be6c-0fe5d1300ca9 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.520001 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a515-3b8d-48d3-be6c-0fe5d1300ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.520275 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a515-3b8d-48d3-be6c-0fe5d1300ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.540579 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0830a515-3b8d-48d3-be6c-0fe5d1300ca9 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:12.541848 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0830a515-3b8d-48d3-be6c-0fe5d1300ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:12.550154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1456/2903] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:12.556181 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe958d54-1c12-444c-807d-9f0d581205c2 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.566911 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe958d54-1c12-444c-807d-9f0d581205c2 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:12.571753 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:12.572279 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.572565 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.572837 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.573526 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:12.573915 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:12.575504 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.587231 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1448/2904] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:12.591746 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a515-3b8d-48d3-be6c-0fe5d1300ca9 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.601686 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a515-3b8d-48d3-be6c-0fe5d1300ca9 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:12.606373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:12.606958 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.607228 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.607494 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.608192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:12.610242 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.703515 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1457/2905] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:12 2022] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:12.707880 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.718716 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df64e4-8763-475f-9089-d0dd11f931f8 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:12.723622 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:12.783309 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:12.783957 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.784250 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.785023 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.785700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:12.787623 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.912102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1449/2906] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:12 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:12.917560 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.932196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef48c3e-f63e-4095-a58f-9fd622730481 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:12.937450 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:12.938064 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.938358 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.939019 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.939291 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:12.941503 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.953643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1458/2907] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:12.958348 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.970495 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013599-2070-4cb4-a605-af968a75793a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:12.976102 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703debc2-20ca-4859-a6d8-0de0751e167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:12.977992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703debc2-20ca-4859-a6d8-0de0751e167d admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.977992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703debc2-20ca-4859-a6d8-0de0751e167d admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.977992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703debc2-20ca-4859-a6d8-0de0751e167d admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.977992 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703debc2-20ca-4859-a6d8-0de0751e167d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:12.979535 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703debc2-20ca-4859-a6d8-0de0751e167d admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.991617 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1450/2908] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:12.996156 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:13.007496 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ecef9-4601-4fa3-a397-c1adb1ed855f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:13.012137 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:13.012789 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.013168 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.013443 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] PATH_INFO: `/v3/projects/a505634de42d49c2b67f3bf1a920f32b/users/2fc7c3d7a6674cd28b75cc5158659209/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.029924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a505634de42d49c2b67f3bf1a920f32b, user_id=2fc7c3d7a6674cd28b75cc5158659209, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:13.032699 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:13.112089 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1459/2909] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:12 2022] PUT /identity/v3/projects/a505634de42d49c2b67f3bf1a920f32b/users/2fc7c3d7a6674cd28b75cc5158659209/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:13.124037 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126690fc-3a08-4364-8a2b-da72a7d2de1f None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.124332 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126690fc-3a08-4364-8a2b-da72a7d2de1f None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.124618 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126690fc-3a08-4364-8a2b-da72a7d2de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.157342 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-126690fc-3a08-4364-8a2b-da72a7d2de1f None None] MFA Rules not processed for user `2fc7c3d7a6674cd28b75cc5158659209`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:13.158571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-126690fc-3a08-4364-8a2b-da72a7d2de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:13.227089 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1451/2910] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:13.239783 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:13.241528 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:13.272605 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:13.300819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ab80d-d0d8-4caf-86c6-dd9c5415b77f admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:13.304491 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac4ee6-7f18-4205-9101-d8a2402d6db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:13.305126 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4ee6-7f18-4205-9101-d8a2402d6db6 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.305395 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4ee6-7f18-4205-9101-d8a2402d6db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.305660 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4ee6-7f18-4205-9101-d8a2402d6db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.314738 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac4ee6-7f18-4205-9101-d8a2402d6db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:13.316192 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac4ee6-7f18-4205-9101-d8a2402d6db6 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:13.324906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1460/2911] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:19.253907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126690fc-3a08-4364-8a2b-da72a7d2de1f None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.319218 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126690fc-3a08-4364-8a2b-da72a7d2de1f None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.323988 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.324619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.324898 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.325202 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] PATH_INFO: `/v3/users/2fc7c3d7a6674cd28b75cc5158659209` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.326339 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc7c3d7a6674cd28b75cc5158659209)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.328244 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.347768 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:19.611691 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc7c3d7a6674cd28b75cc5158659209'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.624544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc7c3d7a6674cd28b75cc5158659209'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.633449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc7c3d7a6674cd28b75cc5158659209'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.724453 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc7c3d7a6674cd28b75cc5158659209'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.725326 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc7c3d7a6674cd28b75cc5158659209'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.732620 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1452/2912] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:19 2022] DELETE /identity/v3/users/2fc7c3d7a6674cd28b75cc5158659209 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:19.737855 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.738683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.738683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.762698 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:19.764196 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.828418 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1461/2913] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:19.840314 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.842216 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.921969 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006e4af-3eb4-4572-9184-ac3cbad9d306 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.925703 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.926308 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.926619 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.926851 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.936271 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.937717 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.947634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1453/2914] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:20.386023 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.388526 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.405223 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2e4c5-158a-4a1b-8939-490f76588f76 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.410950 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.411594 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.411876 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.412149 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] PATH_INFO: `/v3/projects/a505634de42d49c2b67f3bf1a920f32b` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.413357 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a505634de42d49c2b67f3bf1a920f32b)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.428540 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.547200 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a505634de42d49c2b67f3bf1a920f32b', 'request_id': 'req-4500db23-d520-405e-9ed0-f1f8b8287659'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.626216 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a505634de42d49c2b67f3bf1a920f32b', 'request_id': 'req-4500db23-d520-405e-9ed0-f1f8b8287659'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.635888 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a505634de42d49c2b67f3bf1a920f32b', 'request_id': 'req-4500db23-d520-405e-9ed0-f1f8b8287659'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.648898 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] The token cache is being invalidate because project a505634de42d49c2b67f3bf1a920f32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:20.652900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.652900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-4500db23-d520-405e-9ed0-f1f8b8287659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.652900 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1462/2915] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:20 2022] DELETE /identity/v3/projects/a505634de42d49c2b67f3bf1a920f32b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:26.295630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.297104 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:26.310688 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be4fa7-5298-4f57-a9d8-8ee896dc916c service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.369664 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.370355 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.370631 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.370926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] PATH_INFO: `/v3/users/2bfe86ad00a844ed8cc486f1b2589dc4` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.372082 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bfe86ad00a844ed8cc486f1b2589dc4)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:26.374211 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:26.635864 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:26.641938 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bfe86ad00a844ed8cc486f1b2589dc4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:26.654548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bfe86ad00a844ed8cc486f1b2589dc4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:26.662214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bfe86ad00a844ed8cc486f1b2589dc4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:26.758268 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bfe86ad00a844ed8cc486f1b2589dc4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:26.758996 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bfe86ad00a844ed8cc486f1b2589dc4'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:26.765637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1454/2916] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:26 2022] DELETE /identity/v3/users/2bfe86ad00a844ed8cc486f1b2589dc4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:26.770804 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.771336 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.771815 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.792211 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:26.796657 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:26.842302 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:26.857861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1463/2917] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:26.869190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.870869 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:26.931700 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e31ad4-41b1-4405-a70e-8076d4b4884a admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.935366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b64f7d-4391-4255-8c39-f1ec57ebf484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.935977 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b64f7d-4391-4255-8c39-f1ec57ebf484 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.936255 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b64f7d-4391-4255-8c39-f1ec57ebf484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.936528 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b64f7d-4391-4255-8c39-f1ec57ebf484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.946626 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b64f7d-4391-4255-8c39-f1ec57ebf484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:26.948066 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b64f7d-4391-4255-8c39-f1ec57ebf484 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:26.958961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1455/2918] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:27.423123 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:27.425294 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:27.440926 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241436e6-e730-415a-89e2-4b45510e1732 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:27.447791 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:27.448906 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.449362 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.449776 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] PATH_INFO: `/v3/projects/893a1e4537a34c81bccf5b6c45a015a3` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.451391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=893a1e4537a34c81bccf5b6c45a015a3)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.454649 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:27.536091 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893a1e4537a34c81bccf5b6c45a015a3', 'request_id': 'req-735dcf74-cc8e-407b-b27d-02e30fbafa18'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:27.592188 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893a1e4537a34c81bccf5b6c45a015a3', 'request_id': 'req-735dcf74-cc8e-407b-b27d-02e30fbafa18'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:27.599730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893a1e4537a34c81bccf5b6c45a015a3', 'request_id': 'req-735dcf74-cc8e-407b-b27d-02e30fbafa18'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:27.611627 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] The token cache is being invalidate because project 893a1e4537a34c81bccf5b6c45a015a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:27.612551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:27.613252 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-735dcf74-cc8e-407b-b27d-02e30fbafa18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:27.614810 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1464/2919] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:27 2022] DELETE /identity/v3/projects/893a1e4537a34c81bccf5b6c45a015a3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:27.620063 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893156-4efd-4696-9079-b5b6641929a7 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.620571 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893156-4efd-4696-9079-b5b6641929a7 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.620677 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893156-4efd-4696-9079-b5b6641929a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.640575 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-dc893156-4efd-4696-9079-b5b6641929a7 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:27.641809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-dc893156-4efd-4696-9079-b5b6641929a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:27.707558 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1456/2920] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:27.715558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a79ac-a3b0-4bd4-b262-e58f82f88b3a None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.715874 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a79ac-a3b0-4bd4-b262-e58f82f88b3a None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.716172 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a79ac-a3b0-4bd4-b262-e58f82f88b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.737975 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-d77a79ac-a3b0-4bd4-b262-e58f82f88b3a None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:27.739182 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-d77a79ac-a3b0-4bd4-b262-e58f82f88b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:27.747259 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1465/2921] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:27.751824 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893156-4efd-4696-9079-b5b6641929a7 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:27.761779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893156-4efd-4696-9079-b5b6641929a7 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:27.766452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:27.767086 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.767365 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.767634 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.768289 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:27.768585 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.770400 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:27.782661 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1457/2922] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:27.788884 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a79ac-a3b0-4bd4-b262-e58f82f88b3a None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:27.798355 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a79ac-a3b0-4bd4-b262-e58f82f88b3a None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:27.803861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:27.804463 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.804748 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.805049 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] PATH_INFO: `/v3/projects` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.805710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.807611 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:27.896088 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1466/2923] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:27 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:27.900779 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:27.913044 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4d57-0048-47ec-8d3a-33508d45f7e3 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:27.967174 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:27.981311 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:27.984315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.984315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.984315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] PATH_INFO: `/v3/users` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.984315 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.985204 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:28.063749 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1458/2924] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:27 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:28.068033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:28.078715 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1d70-8a3f-4063-9271-bb1c0761f97c admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:28.088587 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:28.089234 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:28.089574 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:28.089861 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:28.090624 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:28.092227 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:28.103840 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1467/2925] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:28.108530 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:28.120561 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7644f-553e-4fc1-9fc1-8e3c42cb9cab admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:28.128427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef0b27-eb0c-41bc-9339-eef6a63cd863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:28.128427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0b27-eb0c-41bc-9339-eef6a63cd863 admin admin] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:28.128427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0b27-eb0c-41bc-9339-eef6a63cd863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:28.128427 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0b27-eb0c-41bc-9339-eef6a63cd863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:28.128948 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef0b27-eb0c-41bc-9339-eef6a63cd863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:28.129151 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef0b27-eb0c-41bc-9339-eef6a63cd863 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:28.140748 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1459/2926] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:28.146284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:28.156968 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdb5a-4a42-48f6-8212-69c30daf8fb4 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:28.162527 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:28.163181 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:28.163462 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:28.163730 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] PATH_INFO: `/v3/projects/022d6ec0a4ab44f3ad8a101ac88e253f/users/264edcc7c3d94fbba6374281ba10b992/roles/63e30c687d4b49118bf8ec5f3341f560` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:28.179558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022d6ec0a4ab44f3ad8a101ac88e253f, user_id=264edcc7c3d94fbba6374281ba10b992, role_id=63e30c687d4b49118bf8ec5f3341f560)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:28.182247 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:28.274744 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1468/2927] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:28 2022] PUT /identity/v3/projects/022d6ec0a4ab44f3ad8a101ac88e253f/users/264edcc7c3d94fbba6374281ba10b992/roles/63e30c687d4b49118bf8ec5f3341f560 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:28.286537 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5a61-3745-4707-a9a2-baf3f41f4d72 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:28.287198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5a61-3745-4707-a9a2-baf3f41f4d72 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:28.287198 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5a61-3745-4707-a9a2-baf3f41f4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:28.316611 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-97fb5a61-3745-4707-a9a2-baf3f41f4d72 None None] MFA Rules not processed for user `264edcc7c3d94fbba6374281ba10b992`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:28.317845 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-97fb5a61-3745-4707-a9a2-baf3f41f4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:28.389107 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1460/2928] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:28.402470 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:28.404403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:28.472920 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87201d51-afc2-44fc-8086-c225a8bead93 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:28.477005 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b60b-b4b0-442c-b1af-efc269d4c823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d2e6366b3c488c8b893584f59a98db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:28.477643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b60b-b4b0-442c-b1af-efc269d4c823 service cinder] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:28.477924 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b60b-b4b0-442c-b1af-efc269d4c823 service cinder] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:28.478201 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b60b-b4b0-442c-b1af-efc269d4c823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:28.487762 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b60b-b4b0-442c-b1af-efc269d4c823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:28.489221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b60b-b4b0-442c-b1af-efc269d4c823 service cinder] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:28.499116 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1469/2929] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:38.385976 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:38.494413 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:40.363789 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5a61-3745-4707-a9a2-baf3f41f4d72 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.428195 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5a61-3745-4707-a9a2-baf3f41f4d72 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.433492 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.434125 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.434416 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.434674 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] PATH_INFO: `/v3/users/264edcc7c3d94fbba6374281ba10b992` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.435932 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264edcc7c3d94fbba6374281ba10b992)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.437943 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.613019 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264edcc7c3d94fbba6374281ba10b992'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:40.625263 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264edcc7c3d94fbba6374281ba10b992'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:40.632190 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264edcc7c3d94fbba6374281ba10b992'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:40.762248 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264edcc7c3d94fbba6374281ba10b992'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:40.762907 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264edcc7c3d94fbba6374281ba10b992'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:40.769286 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1461/2930] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:40 2022] DELETE /identity/v3/users/264edcc7c3d94fbba6374281ba10b992 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:40.774628 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.775163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.775163 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.795452 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] MFA Rules not processed for user `0a6a88d51a2749349d397dd703210284`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:40.796682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:40.856846 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1470/2931] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 21:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:40.866725 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.868122 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:40.927987 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca77ed-0993-44d9-bb4c-9b9cf78a1b95 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.932045 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.932786 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.933087 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.933363 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.946522 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.949512 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.958038 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1462/2932] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:41.388556 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:41.390053 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.404258 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670e6de-c206-4e51-9397-1928d962b7f4 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:41.411021 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:41.411717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.412027 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.412349 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] PATH_INFO: `/v3/projects/022d6ec0a4ab44f3ad8a101ac88e253f` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.414140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022d6ec0a4ab44f3ad8a101ac88e253f)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:41.416202 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:41.586803 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022d6ec0a4ab44f3ad8a101ac88e253f', 'request_id': 'req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.689040 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022d6ec0a4ab44f3ad8a101ac88e253f', 'request_id': 'req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.695894 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022d6ec0a4ab44f3ad8a101ac88e253f', 'request_id': 'req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.707533 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] The token cache is being invalidate because project 022d6ec0a4ab44f3ad8a101ac88e253f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:41.707806 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.708459 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5b7df2d2-17d7-49d3-9551-9cd9601d7bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.709984 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1471/2933] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:41 2022] DELETE /identity/v3/projects/022d6ec0a4ab44f3ad8a101ac88e253f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:50.953544 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:51.704352 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:57.383650 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:57.393235 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb5ae-6743-46f8-87ad-759d894fb29f service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:57.443718 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047c66e-0a98-4dde-b1f5-e2d1779f6e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:57.444366 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c66e-0a98-4dde-b1f5-e2d1779f6e9f service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:57.444647 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c66e-0a98-4dde-b1f5-e2d1779f6e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:57.444920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c66e-0a98-4dde-b1f5-e2d1779f6e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:57.446818 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-8047c66e-0a98-4dde-b1f5-e2d1779f6e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:57.457557 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047c66e-0a98-4dde-b1f5-e2d1779f6e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:57.459010 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047c66e-0a98-4dde-b1f5-e2d1779f6e9f service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:57.467885 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1463/2934] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:01.755055 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba826-a4a7-4a61-acb8-7f8f1517c446 None None] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.755551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba826-a4a7-4a61-acb8-7f8f1517c446 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.755551 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba826-a4a7-4a61-acb8-7f8f1517c446 None None] PATH_INFO: `/` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.756915 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1472/2935] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:01.762903 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5196e4c-b61d-41b3-b354-91a9d55d13a2 None None] REQUEST_METHOD: `POST` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.763411 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5196e4c-b61d-41b3-b354-91a9d55d13a2 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.763533 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5196e4c-b61d-41b3-b354-91a9d55d13a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.803424 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.auth.core [None req-a5196e4c-b61d-41b3-b354-91a9d55d13a2 None None] MFA Rules not processed for user `e72f7d1f9961446c8938e3f161fb03f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:01.804643 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a5196e4c-b61d-41b3-b354-91a9d55d13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:01.813780 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1464/2936] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:42:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:01.825937 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba826-a4a7-4a61-acb8-7f8f1517c446 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:01.827683 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-1ccba826-a4a7-4a61-acb8-7f8f1517c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:01.842075 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba826-a4a7-4a61-acb8-7f8f1517c446 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:01.845870 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b0f6d-dd6c-46e4-9c99-06f67177e0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:01.846481 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b0f6d-dd6c-46e4-9c99-06f67177e0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.846785 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b0f6d-dd6c-46e4-9c99-06f67177e0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.847312 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b0f6d-dd6c-46e4-9c99-06f67177e0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.855641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b0f6d-dd6c-46e4-9c99-06f67177e0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:01.857140 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b0f6d-dd6c-46e4-9c99-06f67177e0d7 service neutron] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:01.865221 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1473/2937] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:01.947722 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0fc30-9707-4a9f-a9e2-5eaef24907e4 None None] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.948013 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0fc30-9707-4a9f-a9e2-5eaef24907e4 None None] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.948425 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0fc30-9707-4a9f-a9e2-5eaef24907e4 None None] PATH_INFO: `/` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.949812 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1465/2938] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 21:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:01.955255 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] REQUEST_METHOD: `POST` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.955539 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.955816 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.995959 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.auth.core [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] MFA Rules not processed for user `5546fd3a7c324d4583817707572b1245`. Rule list: `[]` (Enabled: `True`). {{(pid=81931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:01.997257 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.065558 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1474/2939] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 21:42:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:02.076457 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0fc30-9707-4a9f-a9e2-5eaef24907e4 None None] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:02.078449 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-a7b0fc30-9707-4a9f-a9e2-5eaef24907e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.092179 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0fc30-9707-4a9f-a9e2-5eaef24907e4 None None] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:02.095881 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:02.096471 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.096745 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.097333 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:02.110119 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:02.111541 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:02.122614 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1466/2940] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:02.184964 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:02.186475 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.256643 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17990a-9c79-410d-a5cb-f8b54c935299 None None] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:02.262423 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:02.263034 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.263346 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.263623 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:02.265439 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.277710 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:02.279272 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:02.289170 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1475/2941] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:02.770547 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:02.777524 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.787961 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b852fe8-dc3a-46c8-920b-f73a2ca4c9c3 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:02.795920 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:02.796548 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.796834 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.797139 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:02.799015 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.813040 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:02.814809 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:02.827183 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1467/2942] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:12.284909 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=75 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:12.821564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=47 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:30.542636 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:30.545516 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:30.570590 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb560b6-cc57-45fc-afd9-947d9f91c3b4 service placement] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:30.576154 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5546fd3a7c324d4583817707572b1245', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:30.579198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:30.579198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:30.579198 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:30.579545 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:30.593591 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:30.595191 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:30.610356 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1476/2943] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:35.980832 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:35.990891 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34552b3-23de-424c-bab8-b7667e7914bd service nova] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:35.994735 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72f7d1f9961446c8938e3f161fb03f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:35.995387 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:35.995578 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:35.995852 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:35.997610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:36.066138 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:36.067572 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:36.078162 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1468/2944] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:39.713044 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:39.714499 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:39.730458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8588-72d7-429a-9adc-70dd1b75e454 service nova] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:39.735673 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:39.736284 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:39.736711 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:39.737155 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:39.738899 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:39.753856 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:39.755458 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:39.767033 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1477/2945] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:43.170654 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:43.185121 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18881-9c6c-44b5-9ce4-51bc37191931 service neutron] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:43.190249 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:43.190862 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] REQUEST_METHOD: `GET` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:43.191137 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:43.191410 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:43.193379 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:43.206014 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:43.207610 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:43.218349 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1469/2946] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:43.321862 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:43.324632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:43.341819 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed1f5-c4cc-4c79-8544-6620904797d4 service placement] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:43.346520 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:43.347403 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:43.347682 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:43.347956 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] PATH_INFO: `/v3/users/283e344437594357925fead9c0b2f498` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:43.349142 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283e344437594357925fead9c0b2f498)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:43.351062 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:43.545671 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283e344437594357925fead9c0b2f498'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:43.557694 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283e344437594357925fead9c0b2f498'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:43.558479 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283e344437594357925fead9c0b2f498'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:43.565678 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283e344437594357925fead9c0b2f498'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:43.645672 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283e344437594357925fead9c0b2f498'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:43.652942 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1478/2947] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:43:43 2022] DELETE /identity/v3/users/283e344437594357925fead9c0b2f498 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:43.927701 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:43.938163 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f515d33-3a95-4cc3-a173-af0ee74654dc service placement] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:44.010369 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:44.011003 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:44.011328 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:44.011637 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] PATH_INFO: `/v3/projects/29dbd9901856475880879ff0c64c874d` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:44.012790 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29dbd9901856475880879ff0c64c874d)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:44.014761 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:44.121706 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29dbd9901856475880879ff0c64c874d', 'request_id': 'req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.133362 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29dbd9901856475880879ff0c64c874d', 'request_id': 'req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.139889 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29dbd9901856475880879ff0c64c874d', 'request_id': 'req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.211214 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] The token cache is being invalidate because project 29dbd9901856475880879ff0c64c874d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:43:44.211935 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.212367 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.213939 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1470/2948] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:43:43 2022] DELETE /identity/v3/projects/29dbd9901856475880879ff0c64c874d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:44.218373 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:44.220320 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:44.234632 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291aa09-ff33-45bd-9a15-83c1cc77cf95 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:44.293767 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:44.294412 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:44.294718 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:44.294991 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] PATH_INFO: `/v3/users/2802933c52cc40bb975efb32f5ed6d1a` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:44.296190 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2802933c52cc40bb975efb32f5ed6d1a)` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:44.298251 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:44.548048 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2802933c52cc40bb975efb32f5ed6d1a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.549269 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:44.560822 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2802933c52cc40bb975efb32f5ed6d1a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.561553 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2802933c52cc40bb975efb32f5ed6d1a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.568300 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2802933c52cc40bb975efb32f5ed6d1a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.633751 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.notifications [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2802933c52cc40bb975efb32f5ed6d1a'} {{(pid=81931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:44.640756 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1479/2949] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 21:43:44 2022] DELETE /identity/v3/users/2802933c52cc40bb975efb32f5ed6d1a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:45.134452 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Authenticating user token {{(pid=81932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:45.135926 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.fernet_utils [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:45.151200 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85cdd-ff2c-4347-a2f4-e42d87dc3ff7 admin admin] Validating token access rules against request {{(pid=81932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:45.162630 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:45.216130 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6a88d51a2749349d397dd703210284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '635783c99cd6429c8d3d3df5393b1353', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:45.216894 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:45.217096 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] SCRIPT_NAME: `/identity` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:45.217394 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] PATH_INFO: `/v3/projects/497b401d4b014e9bb864d5cfacad456f` {{(pid=81932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:45.218549 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] RBAC: Authorizing `identity:delete_project(project_id=497b401d4b014e9bb864d5cfacad456f)` {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:45.220609 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] RBAC: Authorization granted {{(pid=81932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:45.326673 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497b401d4b014e9bb864d5cfacad456f', 'request_id': 'req-5519969f-788c-43f2-a312-0181e5e3160e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:45.332587 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497b401d4b014e9bb864d5cfacad456f', 'request_id': 'req-5519969f-788c-43f2-a312-0181e5e3160e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:45.338878 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497b401d4b014e9bb864d5cfacad456f', 'request_id': 'req-5519969f-788c-43f2-a312-0181e5e3160e'} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:45.389278 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] The token cache is being invalidate because project 497b401d4b014e9bb864d5cfacad456f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:43:45.389564 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:45.390170 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG keystone.notifications [None req-5519969f-788c-43f2-a312-0181e5e3160e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:45.391763 dv-cinder-854264-2-smb devstack@keystone.service[81932]: [pid: 81932|app: 0|req: 1471/2950] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 21:43:45 2022] DELETE /identity/v3/projects/497b401d4b014e9bb864d5cfacad456f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:54.702852 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:55.385814 dv-cinder-854264-2-smb devstack@keystone.service[81932]: DEBUG dbcounter [-] [81932] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:17.714218 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Authenticating user token {{(pid=81931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:17.715641 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:17.790489 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccedab-fbb0-4b80-affb-2e7df2b5c6a5 admin admin] Validating token access rules against request {{(pid=81931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:17.851314 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f3d43-de84-4af4-9b16-5c6444ffabb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ffefb33aa940f3a6634ed6745e16d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff9710b9a08545889cc2bcc26bcd8ab0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:17.851935 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f3d43-de84-4af4-9b16-5c6444ffabb3 service placement] REQUEST_METHOD: `GET` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:17.852249 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f3d43-de84-4af4-9b16-5c6444ffabb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:17.852521 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f3d43-de84-4af4-9b16-5c6444ffabb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:17.854923 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.fernet_utils [None req-4c7f3d43-de84-4af4-9b16-5c6444ffabb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:17.866780 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f3d43-de84-4af4-9b16-5c6444ffabb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:17.868391 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f3d43-de84-4af4-9b16-5c6444ffabb3 service placement] RBAC: Authorization granted {{(pid=81931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:17.878717 dv-cinder-854264-2-smb devstack@keystone.service[81931]: [pid: 81931|app: 0|req: 1480/2951] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:27.874514 dv-cinder-854264-2-smb devstack@keystone.service[81931]: DEBUG dbcounter [-] [81931] Writing DB stats keystone:SELECT=58 {{(pid=81931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}